-- Logs begin at Sun 2022-08-07 23:33:31 UTC, end at Mon 2022-08-08 00:48:16 UTC. -- Aug 08 00:14:24.552522 dv-cinder-851640-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 08 00:14:24.560326 dv-cinder-851640-3-smb devstack@keystone.service[86576]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 00:14:24 2022] *** Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: nodename: dv-cinder-851640-3-smb Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: machine: x86_64 Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: clock source: unix Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: pcre jit disabled Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: detected number of CPU cores: 4 Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: current working directory: / Aug 08 00:14:24.563369 dv-cinder-851640-3-smb devstack@keystone.service[86576]: detected binary path: /usr/bin/uwsgi-core Aug 08 00:14:24.563907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: your processes number limit is 47680 Aug 08 00:14:24.563907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: your memory page size is 4096 bytes Aug 08 00:14:24.563907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: detected max file descriptor number: 2048 Aug 08 00:14:24.563907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: lock engine: pthread robust mutexes Aug 08 00:14:24.563907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: thunder lock: enabled Aug 08 00:14:24.563907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 08 00:14:24.563907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 00:14:24.601702 dv-cinder-851640-3-smb devstack@keystone.service[86576]: Python main interpreter initialized at 0x558110baf9c0 Aug 08 00:14:24.601702 dv-cinder-851640-3-smb devstack@keystone.service[86576]: python threads support enabled Aug 08 00:14:24.601702 dv-cinder-851640-3-smb devstack@keystone.service[86576]: your server socket listen backlog is limited to 100 connections Aug 08 00:14:24.601702 dv-cinder-851640-3-smb devstack@keystone.service[86576]: your mercy for graceful operations on workers is 90 seconds Aug 08 00:14:24.602097 dv-cinder-851640-3-smb devstack@keystone.service[86576]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 00:14:24.602177 dv-cinder-851640-3-smb devstack@keystone.service[86576]: *** Operational MODE: preforking *** Aug 08 00:14:24.602907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: *** uWSGI is running in multiple interpreter mode *** Aug 08 00:14:24.602907 dv-cinder-851640-3-smb devstack@keystone.service[86576]: spawned uWSGI master process (pid: 86576) Aug 08 00:14:24.603110 dv-cinder-851640-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 08 00:14:24.603905 dv-cinder-851640-3-smb devstack@keystone.service[86576]: spawned uWSGI worker 1 (pid: 86588, cores: 1) Aug 08 00:14:24.604000 dv-cinder-851640-3-smb devstack@keystone.service[86576]: spawned uWSGI worker 2 (pid: 86589, cores: 1) Aug 08 00:14:24.606816 dv-cinder-851640-3-smb devstack@keystone.service[86576]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 00:14:30.080960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:14:30.080960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: from cryptography.utils import int_from_bytes Aug 08 00:14:30.081748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:14:30.081748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: from cryptography.utils import int_from_bytes Aug 08 00:14:30.082474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:14:30.082474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: from cryptography.utils import int_from_bytes Aug 08 00:14:30.082931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:14:30.082931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: from cryptography.utils import int_from_bytes Aug 08 00:14:30.130525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 00:14:30.130707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 00:14:30.130837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] command line args: [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 00:14:30.131105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 00:14:30.131284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ================================================================================ {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 00:14:30.131407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 00:14:30.131596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] admin_token = **** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.131680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 00:14:30.131822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] command line args: [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 00:14:30.131899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] config_dir = [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.132119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.132200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 00:14:30.132325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] config_source = [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.132410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ================================================================================ {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 00:14:30.132539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] debug = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.132661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] admin_token = **** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.132762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.133012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] config_dir = [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.133233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.133799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.133932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.134043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] config_source = [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.134169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] debug = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.134284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.134380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.134583 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.134688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] list_limit = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] log_config_append = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] log_dir = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] log_file = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] list_limit = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.135995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.136143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] log_config_append = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.136261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.136372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.136491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] log_dir = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.136609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.136726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] log_file = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.136837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.136950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.137059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.137182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.137284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.137399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.137603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.137718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.137919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.138040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.138196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.138316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.138434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.138546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.138665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.138777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.138916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.139076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.139218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.139383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.139514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.139765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.139893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.140118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.140341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.140466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.140577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] publish_errors = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.140791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.140907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.141102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.141224 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.141343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.141601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.141894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.142007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.142152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] publish_errors = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.142265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] standard_threads = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.142459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.142595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.142770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.142888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.142999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.143108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.143218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] use_journal = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.143377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.143491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] use_json = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.143601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] use_stderr = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.143710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.143821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] use_syslog = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.143937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] standard_threads = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.144056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.144201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.144317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.144542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.144658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.144768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.144949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.145073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] use_journal = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.145190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] use_json = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.145301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.145411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] use_stderr = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.145527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] use_syslog = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.145646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.145839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:14:30.145956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.146208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.146331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.146780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.146887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.147142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.147222 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.147481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.147638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.147829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.148000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.148164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.148249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.148476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.148558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.148716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.148859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.148993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.149209 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.149287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.149470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.149545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.149726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.149885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.149983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.150240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.150321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.150476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.150656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.150732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.150913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.150990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.151168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.151253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.151424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.151502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.151668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.151745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.151894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.151971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.152125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.152202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.152361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.152444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.152621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.152699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.152872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.152956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.153105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.153188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.153337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.153421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.153584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.153660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.153830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.153907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.154108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.154206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.154328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.154411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.154556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.154632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.154793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.154877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155494 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.155950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.156988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.157135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.157212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.157368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.157449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.157600 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.157684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.157831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.157914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.158077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.158155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.158320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.158409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.158556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.158633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.158791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.158871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.159944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.160053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.160179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.160335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.160490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.160633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.160633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.160892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.161021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.161149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.161275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.161411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.161411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.161664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.161664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.161913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.162039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.162231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.162381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.162510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.162643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.162777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.162911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.163049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.163178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.163312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.163440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.163567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.163693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.163826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.163961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.164099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.164226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.164352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.164352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.164590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.164724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.164858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.164985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.165111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.165238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.165364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.165508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.165640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.165767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.165907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.166034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.166203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.166388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.166524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.166651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.166784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.166913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.167040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.167177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.167305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.167433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.167559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.167695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.167821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.167957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.168085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.168212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.168337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.168464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.168590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.168788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.168924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.169054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.169186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.169313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.169445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.169596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.169732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.169871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.169999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.170160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.170290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.170417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.170543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.170678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.170810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.170937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.171064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.171190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.171316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.171460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.171589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.171716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] auth.external = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.171841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.171967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.172100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.172234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.172363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.172489 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.172615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.172742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] auth.password = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.172875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.173009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] auth.token = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.173145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.173273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.173399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.173556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.173699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.173829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.173964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.174121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.174258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] auth.external = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.174396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.174524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.174652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.174788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.174918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.175055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.175183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] credential.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.175312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] auth.password = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.175440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.175585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] auth.token = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.175716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.175844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.175972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.176099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.176226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.176362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.176527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.176667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.176806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.176933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.177061 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.177196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.177333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.177467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.177596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.177723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] credential.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.177850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.177985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.178171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.178306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.178437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.178573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.178716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.178852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.178986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.179121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.179250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.179377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.179511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] federation.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.179647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.179776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.179903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.180542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.180677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.180805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.180939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.181078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.181206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.181334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.181334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.181575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.181711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.181840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.182016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.182172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.182301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.182429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.182568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.182699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] federation.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.182844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.182980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.183107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.183234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.183370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.183499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.183626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.183754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.183881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.184014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.184151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.184280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.184408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.184550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.184680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.184881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.185012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.185140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.185268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.185395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.185530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.185670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.185800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.185927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.186055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.186238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.186366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.186514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.186689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.186824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.186954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.187081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.187208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.187344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.187472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.187600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.187727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.187855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.187983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.188117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.188261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.188390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.188517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.188644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.188771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.188910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.189041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.189167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.189295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.189422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.189549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.189684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.189812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.189940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.190100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.190235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.190363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.190502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.190638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.190774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.190902 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.191030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.191158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.191292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.191421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.191549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.191682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.191810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.191947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.192083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.192213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.192340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.192467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.192594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.192722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.192856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.192985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.193113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.193241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.193367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.193494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.193639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.193768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.193896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.194023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.194190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.194319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.194457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.194587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.194714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.194841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.194968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.195095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.195231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.195360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.195503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.195635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.196403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.196541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.196721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.196863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.196997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.197131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.197264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.197398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.197540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.197676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.197810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.197944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.198112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.198255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.198401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.198538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.198678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.198813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.198947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.199089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.199224 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.199358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.199492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.199626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.199760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.199992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.200134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.200270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.200403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.200538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.200538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.200797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.200933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.201067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.201201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.201335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.201468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.201611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.201746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.201891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.202025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.202210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.202346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.202490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.202627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.202761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.202894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.203027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.203161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.203302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.203444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.203579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.203728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.203863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.203997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.204139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.204274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.204408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.204541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.204676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.204809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.204951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.205087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.205221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.205356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.205489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.205639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.205786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.205922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.206057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.206279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.206413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.206547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.206692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.206873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.207007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.207141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.207274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.207408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.207549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.207695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] resource.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.207830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.207963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.208097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.208230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.208370 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.208505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.208638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.208772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.208907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.209040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.209181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.209316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.209450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.209593 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.209727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.209862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.210003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.210198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.210335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.210469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] role.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.210603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.210736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] role.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.210880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] resource.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.211017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.211151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.211301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.211452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.211586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.211797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.211934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.212069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.212203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.212336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.212470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.212611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.212753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.212887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.213021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.213156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.213290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.213516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.213656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.213791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] role.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.213924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.214058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] role.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.214226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.214363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.214498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.214632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.214765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.214898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.214898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.215163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.215307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.215441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.215574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.215724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.215868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.216003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.216136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.216270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.216403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.216536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.216677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.216851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.216991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.217135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.217270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.217403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.217544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.217680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.217814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.217947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.218113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.218255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.218255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.218523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.218657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.218789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.218934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.219067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.219208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.219344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.219478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.219610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.219744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.219876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.220018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.220153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.220286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] token.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.220419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.220553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.220697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.220844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.220978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.221111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.221244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.221376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.221518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.221653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.221787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.221920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.222053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.222212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.222357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.222494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.222637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.222772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.222905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.223038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.223180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.223316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.223449 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] token.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.223584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.223716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.223850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.223990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.224125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.224258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.224392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.224535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.224670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.224811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.224946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.225080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.225213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.connection = **** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.225354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.225498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.225641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.225779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.225920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.226055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.226243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.226378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.226521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.226654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.226799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.226972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.227112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.227247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.227379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.227513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.227655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.227792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.227925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.228058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.228058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.228309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.228460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.228595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.connection = **** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.228736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.228880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.229978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.230291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.231387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.231387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.231387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.231387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.231387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:14:30.231387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 00:14:30.248811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.249047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.249274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.250935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.251174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.251403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.259526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.261724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.287853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.288083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.289811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.290047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.341773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.342167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.393204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.393330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.393401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.393476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.458867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.459096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.459318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.459403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.459553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.459649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.459758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.459840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.459973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.460052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.460187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.460402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.483595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.483825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.483910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.484984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.485113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.497267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.498943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.510127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.510356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.510580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.510765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.510869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.510998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.511081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.511209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.511290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.511421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.511506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.511632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.511847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.512060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 00:14:30.528483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.528693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 00:14:30.528967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.529050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.529185 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 00:14:30.529268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 00:14:30.529475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.529557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.529722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 00:14:30.529803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.529981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.530093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.530280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.530361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.530539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.530800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.542081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.542364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.542615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.542698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.542898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.542980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.543174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.543461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.549729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.550341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.552785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.553071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.553365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.553447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.553654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.553737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.553939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.554029 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.554228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.554311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.554509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.554590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.554793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.554875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.555130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.555709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.555918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.556007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.556195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.556275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.556481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.556762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.579101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.579844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.580601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.580895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.581356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.581657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.585450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.585737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.586029 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.586299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.586590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.586879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.592558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.592845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.593474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.593767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.596825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.597118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.597403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.597685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.597765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.597962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.598051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.598268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.598350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.598542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.598624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.598812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.598906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.599162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.599441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.599723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.614954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.615234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.615870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.616154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.619756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.620757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.622993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.623292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.623953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.624257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.627631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.628638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.630795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.631854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.633962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.634287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.634575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.634868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.635043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.635150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.635351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.635440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.635653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.635947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.636229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.636512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.651741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.651981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.652247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.652519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.652736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.653040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.653316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.653585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.659402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.660529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.660948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.661225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.662114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.662399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.664026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.664954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.665121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.665407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.665685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.666215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.666505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.666818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.667113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.667399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.676991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.677278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.677560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.677844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.678152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.678434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.678712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.678801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.679075 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.679362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.679649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.679938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.680769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.681056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.695678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.697589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.698639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.700588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.701531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.703127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.703570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.704608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.704892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.705140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.705221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.706667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.706965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.707251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.711693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.713298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.713696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.715334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.716225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.716520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.716807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.717084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.718273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.718571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.718861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.719140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.725032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.725325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.725608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.727697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.727992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.728275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.733124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=86589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.733451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.733746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.734026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.734345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.734636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.734912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.735167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=86588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 00:14:30.735249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.735455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.735567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.735739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.735842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.736019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.736120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.736296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.736377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.736583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.736670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.736863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.736944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.737156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.737543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.737822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.738124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.738410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.738685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.738958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 00:14:30.770340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558110baf9c0 pid: 86589 (default app) Aug 08 00:14:30.772782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558110baf9c0 pid: 86588 (default app) Aug 08 00:14:30.774412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f18dd-3a95-4522-ae8e-307da7adc5e7 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:30.774698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f18dd-3a95-4522-ae8e-307da7adc5e7 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:30.774969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f18dd-3a95-4522-ae8e-307da7adc5e7 None None] PATH_INFO: `/v3` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:30.779269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Aug 8 00:14:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:38.317563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260001-413c-487f-adb8-079be27f415f None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:38.318140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260001-413c-487f-adb8-079be27f415f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:38.318140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260001-413c-487f-adb8-079be27f415f None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:38.322598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:14:38.327728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:38.328113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:38.328278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:38.397878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: INFO dbcounter [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] Registered counter for database keystone Aug 08 00:14:38.417578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG oslo_db.sqlalchemy.engines [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:14:38.423735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writer thread running {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:14:38.602534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG passlib.handlers.bcrypt [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86589) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 00:14:38.602863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG passlib.handlers.bcrypt [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86589) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 00:14:38.657088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:38.658721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:38.786580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 00:14:38.905363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5260001-413c-487f-adb8-079be27f415f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:38.974076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: INFO dbcounter [None req-f5260001-413c-487f-adb8-079be27f415f None None] Registered counter for database keystone Aug 08 00:14:38.995464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG oslo_db.sqlalchemy.engines [None req-f5260001-413c-487f-adb8-079be27f415f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:14:39.001642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writer thread running {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:14:39.120196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5260001-413c-487f-adb8-079be27f415f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:39.124392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa838bc-8fbb-4caf-8df2-c5f51b769e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:39.125005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa838bc-8fbb-4caf-8df2-c5f51b769e68 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:39.125285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa838bc-8fbb-4caf-8df2-c5f51b769e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:39.125556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa838bc-8fbb-4caf-8df2-c5f51b769e68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:39.134094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa838bc-8fbb-4caf-8df2-c5f51b769e68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:39.185280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5aa838bc-8fbb-4caf-8df2-c5f51b769e68 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 00:14:39.185626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa838bc-8fbb-4caf-8df2-c5f51b769e68 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:39.196177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Aug 8 00:14:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 00:14:39.202205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:39.216773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b48502-e4ac-4275-ac66-c9464514cb35 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:39.221243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0a83b-e5d2-43f4-9a9c-6014e649360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:39.222383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0a83b-e5d2-43f4-9a9c-6014e649360a admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:39.222667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0a83b-e5d2-43f4-9a9c-6014e649360a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:39.222937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0a83b-e5d2-43f4-9a9c-6014e649360a admin admin] PATH_INFO: `/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:39.224378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0a83b-e5d2-43f4-9a9c-6014e649360a admin admin] RBAC: Authorizing `identity:get_project(project_id=c2bbcd4a1f6a42dcb7f98d6bb69581ae)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:39.274792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d7c0a83b-e5d2-43f4-9a9c-6014e649360a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 00:14:39.275132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0a83b-e5d2-43f4-9a9c-6014e649360a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:39.279752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Aug 8 00:14:39 2022] GET /identity/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:41.225261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748da35-edac-4824-ad6d-983d52efa319 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:41.225772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748da35-edac-4824-ad6d-983d52efa319 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:41.225859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748da35-edac-4824-ad6d-983d52efa319 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:41.230493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:14:41.235776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb2bcf-31f9-44f7-b3e4-5039374e627c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:41.236188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb2bcf-31f9-44f7-b3e4-5039374e627c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:41.236355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb2bcf-31f9-44f7-b3e4-5039374e627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:41.257599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-84bb2bcf-31f9-44f7-b3e4-5039374e627c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:41.259147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-84bb2bcf-31f9-44f7-b3e4-5039374e627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:41.266864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 00:14:41.290025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748da35-edac-4824-ad6d-983d52efa319 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:41.301737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748da35-edac-4824-ad6d-983d52efa319 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:41.305888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd190512-763d-4e3b-a300-344e406d0c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:41.306506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190512-763d-4e3b-a300-344e406d0c6e admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:41.306785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190512-763d-4e3b-a300-344e406d0c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:41.307056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190512-763d-4e3b-a300-344e406d0c6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:41.314631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd190512-763d-4e3b-a300-344e406d0c6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:41.316394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd190512-763d-4e3b-a300-344e406d0c6e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:41.324931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Aug 8 00:14:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:14:41.330006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb2bcf-31f9-44f7-b3e4-5039374e627c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:41.339304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb2bcf-31f9-44f7-b3e4-5039374e627c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:41.343572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7b9bc-fcb6-4127-aa22-155ac444116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:41.344173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7b9bc-fcb6-4127-aa22-155ac444116b admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:41.344451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7b9bc-fcb6-4127-aa22-155ac444116b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:41.344720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7b9bc-fcb6-4127-aa22-155ac444116b admin admin] PATH_INFO: `/v3/users/3586962b191746b79d7ae426435a3f36` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:41.346009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7b9bc-fcb6-4127-aa22-155ac444116b admin admin] RBAC: Authorizing `identity:get_user(user_id=3586962b191746b79d7ae426435a3f36)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:41.347814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7b9bc-fcb6-4127-aa22-155ac444116b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:41.349294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Aug 8 00:14:41 2022] GET /identity/v3/users/3586962b191746b79d7ae426435a3f36 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:43.376920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13bd2-3599-4953-bd66-09d65668ef1b None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:43.377469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13bd2-3599-4953-bd66-09d65668ef1b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:43.377469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13bd2-3599-4953-bd66-09d65668ef1b None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:43.378804 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:14:43.384405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d556-7239-4317-b232-96de8ed4be16 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:43.384823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d556-7239-4317-b232-96de8ed4be16 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:43.385033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d556-7239-4317-b232-96de8ed4be16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:43.403396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-6b32d556-7239-4317-b232-96de8ed4be16 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:43.404570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6b32d556-7239-4317-b232-96de8ed4be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:43.482847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:43.505218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d13bd2-3599-4953-bd66-09d65668ef1b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:43.526221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbdcf-bbb2-4fcf-9a8b-ba8b7e55c4b2 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:43.526516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbdcf-bbb2-4fcf-9a8b-ba8b7e55c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:43.526787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbdcf-bbb2-4fcf-9a8b-ba8b7e55c4b2 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:43.528119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 7/12] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:14:43.533194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cae0-6ef6-4139-8619-9d6e521ab786 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:43.533481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cae0-6ef6-4139-8619-9d6e521ab786 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:43.533758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cae0-6ef6-4139-8619-9d6e521ab786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:43.551458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c5a7cae0-6ef6-4139-8619-9d6e521ab786 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:43.552646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c5a7cae0-6ef6-4139-8619-9d6e521ab786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:43.570435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:43.622898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:14:43.645047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7cae0-6ef6-4139-8619-9d6e521ab786 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:43.651129 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d13bd2-3599-4953-bd66-09d65668ef1b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:43.685069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed46c3d-fdb2-42e5-b35f-24426944b34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:43.685926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed46c3d-fdb2-42e5-b35f-24426944b34c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:43.686249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed46c3d-fdb2-42e5-b35f-24426944b34c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:43.686527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed46c3d-fdb2-42e5-b35f-24426944b34c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:43.697853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed46c3d-fdb2-42e5-b35f-24426944b34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-8ed46c3d-fdb2-42e5-b35f-24426944b34c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:14:43.706544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:43.707484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:14:43.708438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:14:43.714001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed46c3d-fdb2-42e5-b35f-24426944b34c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:43.747962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7cae0-6ef6-4139-8619-9d6e521ab786 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:43.748510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:43.782238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10493a75-e54a-4032-96e3-01350c4896bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:43.783070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493a75-e54a-4032-96e3-01350c4896bd None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:43.783353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493a75-e54a-4032-96e3-01350c4896bd None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:43.783626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493a75-e54a-4032-96e3-01350c4896bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:43.805191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:43.818791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed46c3d-fdb2-42e5-b35f-24426944b34c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:43.850974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10493a75-e54a-4032-96e3-01350c4896bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:43.854578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10493a75-e54a-4032-96e3-01350c4896bd None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:43.857270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:43.857890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:43.858211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:43.858487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:43.859159 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:43.859461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:43.860825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:43.872855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:43.878359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:43.975731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:43.982556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aa529-950e-467e-be0b-62d999822e23 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:44.017623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd6cf4-a2c4-4395-b73d-6d2519db9cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:44.018284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd6cf4-a2c4-4395-b73d-6d2519db9cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:44.018563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd6cf4-a2c4-4395-b73d-6d2519db9cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:44.018831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd6cf4-a2c4-4395-b73d-6d2519db9cd3 None admin] PATH_INFO: `/v3/users/3586962b191746b79d7ae426435a3f36` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:44.020410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd6cf4-a2c4-4395-b73d-6d2519db9cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=3586962b191746b79d7ae426435a3f36)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:44.022144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd6cf4-a2c4-4395-b73d-6d2519db9cd3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:44.024285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:14:43 2022] GET /identity/v3/users/3586962b191746b79d7ae426435a3f36 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:44.029821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd6cf4-a2c4-4395-b73d-6d2519db9cd3 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:44.057714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:14:44.063310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10493a75-e54a-4032-96e3-01350c4896bd None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:44.115462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:44.129488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd6cf4-a2c4-4395-b73d-6d2519db9cd3 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:44.162511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10493a75-e54a-4032-96e3-01350c4896bd None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:44.163035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25db7-a8d1-4c9f-a5ae-d323983bdb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:44.164156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25db7-a8d1-4c9f-a5ae-d323983bdb23 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:44.164440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25db7-a8d1-4c9f-a5ae-d323983bdb23 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:44.164713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25db7-a8d1-4c9f-a5ae-d323983bdb23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:44.165919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25db7-a8d1-4c9f-a5ae-d323983bdb23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:44.167381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25db7-a8d1-4c9f-a5ae-d323983bdb23 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:44.168945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:44.174640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25db7-a8d1-4c9f-a5ae-d323983bdb23 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:44.196284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:44.196902 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:44.197182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:44.197449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:44.206026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:44.207113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:44.208590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:14:44.226883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:44.227740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:14:44.228565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:14:44.228565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:14:44.228565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:14:44.228565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:14:44.233602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:44.275307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25db7-a8d1-4c9f-a5ae-d323983bdb23 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:44.307971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f3c27-8766-402e-a1a5-2e09626cdafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:44.308568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f3c27-8766-402e-a1a5-2e09626cdafd None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:44.308848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f3c27-8766-402e-a1a5-2e09626cdafd None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:44.309129 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f3c27-8766-402e-a1a5-2e09626cdafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:44.309841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f3c27-8766-402e-a1a5-2e09626cdafd None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.domain.id=default, user.id=3586962b191746b79d7ae426435a3f36) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:44.310175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f3c27-8766-402e-a1a5-2e09626cdafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:44.311610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f3c27-8766-402e-a1a5-2e09626cdafd None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:44.319841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Aug 8 00:14:44 2022] GET /identity/v3/role_assignments?user.id=3586962b191746b79d7ae426435a3f36&scope.domain.id=default&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:44.331608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a2fa1-2e9c-42a2-9172-a403cc1c543b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:44.334304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:44.368937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea54c9-d606-4e19-be7b-1a2275111d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:44.369563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea54c9-d606-4e19-be7b-1a2275111d40 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:44.369843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea54c9-d606-4e19-be7b-1a2275111d40 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:44.370146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea54c9-d606-4e19-be7b-1a2275111d40 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:44.370836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea54c9-d606-4e19-be7b-1a2275111d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:44.371139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea54c9-d606-4e19-be7b-1a2275111d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:44.372578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea54c9-d606-4e19-be7b-1a2275111d40 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:44.391384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:46.467311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929a4f-2b8e-44d8-8fda-68d75a462a15 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:46.468309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929a4f-2b8e-44d8-8fda-68d75a462a15 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:46.468818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929a4f-2b8e-44d8-8fda-68d75a462a15 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:46.470433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:46.476595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd54ef0-ef39-46e5-8206-01f705d58325 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:46.477435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd54ef0-ef39-46e5-8206-01f705d58325 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:46.477907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd54ef0-ef39-46e5-8206-01f705d58325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:46.507114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-efd54ef0-ef39-46e5-8206-01f705d58325 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:46.508634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-efd54ef0-ef39-46e5-8206-01f705d58325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:46.592785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:46.631777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00929a4f-2b8e-44d8-8fda-68d75a462a15 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:46.750523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:46.757828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00929a4f-2b8e-44d8-8fda-68d75a462a15 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:46.803610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082351a-6727-4b3e-a646-a2ec0414a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:46.804789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082351a-6727-4b3e-a646-a2ec0414a121 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:46.805069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082351a-6727-4b3e-a646-a2ec0414a121 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:46.805338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082351a-6727-4b3e-a646-a2ec0414a121 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:46.826944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082351a-6727-4b3e-a646-a2ec0414a121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-d082351a-6727-4b3e-a646-a2ec0414a121 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:14:46.831699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:46.832575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:14:46.833327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 12/24] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:14:46.839009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd54ef0-ef39-46e5-8206-01f705d58325 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:46.964093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91a82-c422-49a6-a5ab-a8d1426f06ce None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:46.964401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91a82-c422-49a6-a5ab-a8d1426f06ce None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:46.964639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91a82-c422-49a6-a5ab-a8d1426f06ce None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:46.966296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:46.976674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e56da-d88e-4ef8-8072-e6e74e238bb2 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:46.976946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e56da-d88e-4ef8-8072-e6e74e238bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:46.977223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e56da-d88e-4ef8-8072-e6e74e238bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.007769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG passlib.handlers.bcrypt [None req-b35e56da-d88e-4ef8-8072-e6e74e238bb2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86588) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 00:14:47.008117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG passlib.handlers.bcrypt [None req-b35e56da-d88e-4ef8-8072-e6e74e238bb2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86588) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 00:14:47.034485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:47.037224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd54ef0-ef39-46e5-8206-01f705d58325 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:47.086094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b35e56da-d88e-4ef8-8072-e6e74e238bb2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:47.086094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b35e56da-d88e-4ef8-8072-e6e74e238bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:47.092605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:47.093483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.093960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.094460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.095337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:47.095851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:47.097447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:47.109699 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 13/26] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:47.122280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:47.261419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:14:47.262956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb103e3-0b99-4d65-931f-5cc329cb0dd6 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.263249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb103e3-0b99-4d65-931f-5cc329cb0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.263524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb103e3-0b99-4d65-931f-5cc329cb0dd6 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.264854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 15/28] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:47.273399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497980-dc01-41e5-9128-c61fca9b3f1b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.273704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497980-dc01-41e5-9128-c61fca9b3f1b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.273960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497980-dc01-41e5-9128-c61fca9b3f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.310738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d3497980-dc01-41e5-9128-c61fca9b3f1b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:47.311952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d3497980-dc01-41e5-9128-c61fca9b3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:47.328228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a67e91-40f9-4698-b025-3baa9af9a553 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:47.373497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c604232-8f44-416e-8057-be4df57a2bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:47.374484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604232-8f44-416e-8057-be4df57a2bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.374930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604232-8f44-416e-8057-be4df57a2bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.375442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604232-8f44-416e-8057-be4df57a2bd7 None admin] PATH_INFO: `/v3/users/3586962b191746b79d7ae426435a3f36` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.376837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c604232-8f44-416e-8057-be4df57a2bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=3586962b191746b79d7ae426435a3f36)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:47.378628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c604232-8f44-416e-8057-be4df57a2bd7 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:47.380499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 14/29] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:14:47 2022] GET /identity/v3/users/3586962b191746b79d7ae426435a3f36 => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:47.381445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c604232-8f44-416e-8057-be4df57a2bd7 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:47.412672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:47.494564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 16/30] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:47.501985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946369-43ae-4fd7-b9a9-2b86a5db1da1 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.502320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946369-43ae-4fd7-b9a9-2b86a5db1da1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.502603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946369-43ae-4fd7-b9a9-2b86a5db1da1 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.503856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 17/31] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:47.508099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37946369-43ae-4fd7-b9a9-2b86a5db1da1 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:47.510669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c604232-8f44-416e-8057-be4df57a2bd7 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:47.539133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:47.557863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb018245-b9fa-49c3-a356-4c43e0d36b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:47.559915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018245-b9fa-49c3-a356-4c43e0d36b41 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.560208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018245-b9fa-49c3-a356-4c43e0d36b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.560483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018245-b9fa-49c3-a356-4c43e0d36b41 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.561150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb018245-b9fa-49c3-a356-4c43e0d36b41 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:47.562801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb018245-b9fa-49c3-a356-4c43e0d36b41 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:47.637027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37946369-43ae-4fd7-b9a9-2b86a5db1da1 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:47.674480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a90b7e-c72e-47a3-af7d-429252a255ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:47.675455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a90b7e-c72e-47a3-af7d-429252a255ba None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.675940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a90b7e-c72e-47a3-af7d-429252a255ba None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.676441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a90b7e-c72e-47a3-af7d-429252a255ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.678099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a90b7e-c72e-47a3-af7d-429252a255ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:47.679845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a90b7e-c72e-47a3-af7d-429252a255ba None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:47.681639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 18/32] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:47.683027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3d081-d5a3-40e3-bcf3-bd532597bb88 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.683532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3d081-d5a3-40e3-bcf3-bd532597bb88 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.684030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3d081-d5a3-40e3-bcf3-bd532597bb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.703063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-85f3d081-d5a3-40e3-bcf3-bd532597bb88 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:47.704569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-85f3d081-d5a3-40e3-bcf3-bd532597bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:47.704964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 15/33] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 00:14:47 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:14:47.706220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb018245-b9fa-49c3-a356-4c43e0d36b41 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:47.783430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 19/34] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:47.784710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3d081-d5a3-40e3-bcf3-bd532597bb88 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:47.802484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:47.815104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:47.836881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb018245-b9fa-49c3-a356-4c43e0d36b41 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:47.876650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:47.877310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:47.877596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:47.877872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:47.890204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:47.892023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:14:47.909449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:47.910406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:14:47.911193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:14:47.911193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:14:47.911193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:14:47.911193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 16/35] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:14:47.916255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:47.966176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3d081-d5a3-40e3-bcf3-bd532597bb88 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:48.005181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d866a7b-fea5-4db6-807c-d725313974fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:48.005857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d866a7b-fea5-4db6-807c-d725313974fc None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.006171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d866a7b-fea5-4db6-807c-d725313974fc None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.006562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d866a7b-fea5-4db6-807c-d725313974fc None admin] PATH_INFO: `/v3/domains/default/users/3586962b191746b79d7ae426435a3f36/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.008806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d866a7b-fea5-4db6-807c-d725313974fc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3586962b191746b79d7ae426435a3f36, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:48.010541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d866a7b-fea5-4db6-807c-d725313974fc None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:48.043786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407318c-0e1d-4a4b-abf8-63af84dd90e7 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:48.084842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160206-be2b-41f6-8a37-9933cd1d5190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:48.085973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160206-be2b-41f6-8a37-9933cd1d5190 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.086289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160206-be2b-41f6-8a37-9933cd1d5190 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.086617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160206-be2b-41f6-8a37-9933cd1d5190 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.087399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9160206-be2b-41f6-8a37-9933cd1d5190 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:48.088865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9160206-be2b-41f6-8a37-9933cd1d5190 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:48.093518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:48.107823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 17/36] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 00:14:47 2022] POST /identity/v3/roles => generated 225 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:14:48.108886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160206-be2b-41f6-8a37-9933cd1d5190 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:48.140080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 20/37] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Aug 8 00:14:47 2022] PUT /identity/v3/domains/default/users/3586962b191746b79d7ae426435a3f36/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:14:48.199040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d362490-7b51-4c16-beae-68b79bbd461b None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.199376 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d362490-7b51-4c16-beae-68b79bbd461b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.199616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d362490-7b51-4c16-beae-68b79bbd461b None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.207019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 21/38] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:48.215675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76583a-2204-4749-971d-b1509244b47b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.216009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76583a-2204-4749-971d-b1509244b47b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.216234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76583a-2204-4749-971d-b1509244b47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.240487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160206-be2b-41f6-8a37-9933cd1d5190 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:48.254808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8f76583a-2204-4749-971d-b1509244b47b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:48.256381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8f76583a-2204-4749-971d-b1509244b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:48.286903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003b47-a228-4b61-b157-11662de5672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:48.287601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003b47-a228-4b61-b157-11662de5672e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.288590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003b47-a228-4b61-b157-11662de5672e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.288880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003b47-a228-4b61-b157-11662de5672e None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.289670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003b47-a228-4b61-b157-11662de5672e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:48.289980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003b47-a228-4b61-b157-11662de5672e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:48.291732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003b47-a228-4b61-b157-11662de5672e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:48.307627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 18/39] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:48.314963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003b47-a228-4b61-b157-11662de5672e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:48.372846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 22/40] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:48.391607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:48.399456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76583a-2204-4749-971d-b1509244b47b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:48.404001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:48.448491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003b47-a228-4b61-b157-11662de5672e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:48.487521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbeed1-068f-4390-be84-86a2881a0a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:48.488205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbeed1-068f-4390-be84-86a2881a0a51 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.488490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbeed1-068f-4390-be84-86a2881a0a51 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.488766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbeed1-068f-4390-be84-86a2881a0a51 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.489456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbeed1-068f-4390-be84-86a2881a0a51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:48.490943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbeed1-068f-4390-be84-86a2881a0a51 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:48.522109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 19/41] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:14:48 2022] POST /identity/v3/projects => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:14:48.523878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0323b-3bac-41bd-89ad-d1fbf0b3f9af None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.524167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0323b-3bac-41bd-89ad-d1fbf0b3f9af None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.524444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0323b-3bac-41bd-89ad-d1fbf0b3f9af None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.525835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 20/42] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:48.528920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76583a-2204-4749-971d-b1509244b47b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:48.531321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb917-7663-4a74-9292-0960cc50e051 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.531607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb917-7663-4a74-9292-0960cc50e051 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.531881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb917-7663-4a74-9292-0960cc50e051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.552342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d52cb917-7663-4a74-9292-0960cc50e051 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:48.554043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d52cb917-7663-4a74-9292-0960cc50e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:48.586264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279ef7-b749-4993-af04-1300581c4778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:48.587700 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279ef7-b749-4993-af04-1300581c4778 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.588475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279ef7-b749-4993-af04-1300581c4778 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.588952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279ef7-b749-4993-af04-1300581c4778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.591007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76279ef7-b749-4993-af04-1300581c4778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:48.593402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76279ef7-b749-4993-af04-1300581c4778 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:48.596641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 23/43] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:48.602674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279ef7-b749-4993-af04-1300581c4778 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:48.638974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 21/44] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:48.661385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cb917-7663-4a74-9292-0960cc50e051 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:48.697891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:48.710098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:48.742379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279ef7-b749-4993-af04-1300581c4778 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:48.777992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cb917-7663-4a74-9292-0960cc50e051 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:48.780950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699ecec-9e5d-40ce-8cee-c97c9625c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:48.781089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699ecec-9e5d-40ce-8cee-c97c9625c760 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.781451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699ecec-9e5d-40ce-8cee-c97c9625c760 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.781795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699ecec-9e5d-40ce-8cee-c97c9625c760 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.782536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699ecec-9e5d-40ce-8cee-c97c9625c760 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:48.784067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699ecec-9e5d-40ce-8cee-c97c9625c760 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:48.813618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd2f56-5e9a-47fb-aa03-c41ef5796e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:48.814555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2f56-5e9a-47fb-aa03-c41ef5796e7f None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:48.814895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2f56-5e9a-47fb-aa03-c41ef5796e7f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:48.815178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2f56-5e9a-47fb-aa03-c41ef5796e7f None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:48.815917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd2f56-5e9a-47fb-aa03-c41ef5796e7f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:48.817477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd2f56-5e9a-47fb-aa03-c41ef5796e7f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:48.827921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 24/45] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:14:48 2022] POST /identity/v3/projects => generated 312 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:14:48.835807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 00:14:48 2022] POST /identity/v3/roles => generated 223 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:14:50.283072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c9d3-9bb7-4fec-8bdd-15bcdfe42712 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:50.283879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c9d3-9bb7-4fec-8bdd-15bcdfe42712 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:50.283879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c9d3-9bb7-4fec-8bdd-15bcdfe42712 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:50.285238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 25/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:50.290891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff08b4-778f-4bc5-8e97-338d4defc275 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:50.291313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff08b4-778f-4bc5-8e97-338d4defc275 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:50.291455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff08b4-778f-4bc5-8e97-338d4defc275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:50.309268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-6bff08b4-778f-4bc5-8e97-338d4defc275 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:50.310504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6bff08b4-778f-4bc5-8e97-338d4defc275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:50.375708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:50.398741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168c9d3-9bb7-4fec-8bdd-15bcdfe42712 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:50.505432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168c9d3-9bb7-4fec-8bdd-15bcdfe42712 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:50.529044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:50.541217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd48ce-340f-474d-9916-33387576b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:50.541777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd48ce-340f-474d-9916-33387576b158 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:50.542058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd48ce-340f-474d-9916-33387576b158 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:50.542361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd48ce-340f-474d-9916-33387576b158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:50.552314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd48ce-340f-474d-9916-33387576b158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-cdbd48ce-340f-474d-9916-33387576b158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:14:50.557048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:50.558022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:14:50.558813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 26/49] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:14:50.565474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff08b4-778f-4bc5-8e97-338d4defc275 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:50.592825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:50.663800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff08b4-778f-4bc5-8e97-338d4defc275 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:50.698434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f8ae7-89f1-4fd9-af19-dc9b760ed2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:50.699042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f8ae7-89f1-4fd9-af19-dc9b760ed2fb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:50.699328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f8ae7-89f1-4fd9-af19-dc9b760ed2fb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:50.699605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f8ae7-89f1-4fd9-af19-dc9b760ed2fb None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:50.700275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f8ae7-89f1-4fd9-af19-dc9b760ed2fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:50.700587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f8ae7-89f1-4fd9-af19-dc9b760ed2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:50.701988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f8ae7-89f1-4fd9-af19-dc9b760ed2fb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:50.710807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 24/50] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:50.718176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd48ce-340f-474d-9916-33387576b158 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:50.814430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd48ce-340f-474d-9916-33387576b158 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:50.848326 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998b765-7e92-432a-8aba-2c814707bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:50.848959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998b765-7e92-432a-8aba-2c814707bd91 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:50.849955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998b765-7e92-432a-8aba-2c814707bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:50.850273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998b765-7e92-432a-8aba-2c814707bd91 None admin] PATH_INFO: `/v3/users/3586962b191746b79d7ae426435a3f36` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:50.852059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998b765-7e92-432a-8aba-2c814707bd91 None admin] RBAC: Authorizing `identity:get_user(user_id=3586962b191746b79d7ae426435a3f36)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:50.853531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998b765-7e92-432a-8aba-2c814707bd91 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:50.855273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 27/51] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:14:50 2022] GET /identity/v3/users/3586962b191746b79d7ae426435a3f36 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:50.858737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c363-5eda-4f80-bc1b-03cce697db94 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:50.859032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c363-5eda-4f80-bc1b-03cce697db94 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:50.859308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c363-5eda-4f80-bc1b-03cce697db94 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:50.860580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998b765-7e92-432a-8aba-2c814707bd91 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:50.860680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 25/52] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:14:50.865582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6965b1f-8525-460e-8d14-f3ad16a9b2bc None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:50.865867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6965b1f-8525-460e-8d14-f3ad16a9b2bc None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:50.866171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6965b1f-8525-460e-8d14-f3ad16a9b2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:50.883854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d6965b1f-8525-460e-8d14-f3ad16a9b2bc None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:50.885040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d6965b1f-8525-460e-8d14-f3ad16a9b2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:50.916120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:50.953173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 26/53] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:14:50.963231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998b765-7e92-432a-8aba-2c814707bd91 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:50.977884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6965b1f-8525-460e-8d14-f3ad16a9b2bc None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:50.997841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c67a04-ccb3-47e0-b21f-ab25254c7fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:50.998493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67a04-ccb3-47e0-b21f-ab25254c7fa9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:50.998783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67a04-ccb3-47e0-b21f-ab25254c7fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:50.998954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:50.999047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67a04-ccb3-47e0-b21f-ab25254c7fa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:51.000483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c67a04-ccb3-47e0-b21f-ab25254c7fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:51.001992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c67a04-ccb3-47e0-b21f-ab25254c7fa9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:51.003583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 28/54] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:51.009699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c67a04-ccb3-47e0-b21f-ab25254c7fa9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:51.082516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6965b1f-8525-460e-8d14-f3ad16a9b2bc None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:51.109664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c67a04-ccb3-47e0-b21f-ab25254c7fa9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:51.117737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199f37-14b0-45f4-9c81-b713df73e56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:51.118413 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199f37-14b0-45f4-9c81-b713df73e56d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:51.118756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199f37-14b0-45f4-9c81-b713df73e56d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:51.119059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199f37-14b0-45f4-9c81-b713df73e56d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:51.120281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199f37-14b0-45f4-9c81-b713df73e56d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:51.121832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199f37-14b0-45f4-9c81-b713df73e56d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:51.123586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:51.129058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:51.129597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199f37-14b0-45f4-9c81-b713df73e56d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:51.143834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e4f6a-e2f0-496e-ac94-54679cb9bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:51.144430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4f6a-e2f0-496e-ac94-54679cb9bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:51.144736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4f6a-e2f0-496e-ac94-54679cb9bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:51.144986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4f6a-e2f0-496e-ac94-54679cb9bbf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:51.145959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e4f6a-e2f0-496e-ac94-54679cb9bbf8 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.domain.id=default, user.id=3586962b191746b79d7ae426435a3f36) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:51.146295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e4f6a-e2f0-496e-ac94-54679cb9bbf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:51.148248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e4f6a-e2f0-496e-ac94-54679cb9bbf8 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:51.154293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Aug 8 00:14:51 2022] GET /identity/v3/role_assignments?user.id=3586962b191746b79d7ae426435a3f36&scope.domain.id=default&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:14:51.229703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:51.243380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199f37-14b0-45f4-9c81-b713df73e56d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:51.280124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7e87a-9c30-4fe8-8462-c800c1dffc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:51.280821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e87a-9c30-4fe8-8462-c800c1dffc33 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:51.281133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e87a-9c30-4fe8-8462-c800c1dffc33 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:51.281456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e87a-9c30-4fe8-8462-c800c1dffc33 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:51.282184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7e87a-9c30-4fe8-8462-c800c1dffc33 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:51.283667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7e87a-9c30-4fe8-8462-c800c1dffc33 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:51.312972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Aug 8 00:14:51 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:14:53.285069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0671-f408-49a7-bda1-6adb5390c1a5 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:53.285574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0671-f408-49a7-bda1-6adb5390c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:53.285657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0671-f408-49a7-bda1-6adb5390c1a5 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:53.286994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:53.292481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3248-0e12-46c2-9cd0-3dc814461cf6 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:53.292866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3248-0e12-46c2-9cd0-3dc814461cf6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:53.293044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3248-0e12-46c2-9cd0-3dc814461cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:53.311003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7a4a3248-0e12-46c2-9cd0-3dc814461cf6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:53.312179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7a4a3248-0e12-46c2-9cd0-3dc814461cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:53.375724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:53.399383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c0671-f408-49a7-bda1-6adb5390c1a5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:53.502038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c0671-f408-49a7-bda1-6adb5390c1a5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:53.534466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e2845-9936-4caf-8df1-37b729993a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:53.535129 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2845-9936-4caf-8df1-37b729993a35 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:53.535365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2845-9936-4caf-8df1-37b729993a35 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:53.535640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2845-9936-4caf-8df1-37b729993a35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:53.536743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e2845-9936-4caf-8df1-37b729993a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:53.538244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e2845-9936-4caf-8df1-37b729993a35 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:53.539793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:53.545369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a3248-0e12-46c2-9cd0-3dc814461cf6 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:53.611491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:53.642033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a3248-0e12-46c2-9cd0-3dc814461cf6 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:53.674740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95ab58-edac-47f4-a912-c9027230b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:53.675340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ab58-edac-47f4-a912-c9027230b9a3 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:53.675625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ab58-edac-47f4-a912-c9027230b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:53.675903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ab58-edac-47f4-a912-c9027230b9a3 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:53.676547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95ab58-edac-47f4-a912-c9027230b9a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:53.678007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95ab58-edac-47f4-a912-c9027230b9a3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:53.703068 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:14:53 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:14:56.936172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3ee4-dc32-4894-8204-240639e4a02f None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:56.937034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3ee4-dc32-4894-8204-240639e4a02f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:56.937452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3ee4-dc32-4894-8204-240639e4a02f None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:56.939009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:56.947716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d6120-8e26-4bfa-a84e-a2fec305d4fe None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:56.949029 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d6120-8e26-4bfa-a84e-a2fec305d4fe None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:56.949516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d6120-8e26-4bfa-a84e-a2fec305d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:56.974120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-dc5d6120-8e26-4bfa-a84e-a2fec305d4fe None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:56.975575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dc5d6120-8e26-4bfa-a84e-a2fec305d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:57.065266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:57.093335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3111-1a56-499d-bf68-8128df5da6de None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.093843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3111-1a56-499d-bf68-8128df5da6de None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.094321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3111-1a56-499d-bf68-8128df5da6de None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.095835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 33/64] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:57.103560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b4ee-24ae-48f0-ba9d-dd2df772517f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.104026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b4ee-24ae-48f0-ba9d-dd2df772517f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.104446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b4ee-24ae-48f0-ba9d-dd2df772517f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.111161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d6120-8e26-4bfa-a84e-a2fec305d4fe None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.137878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4182b4ee-24ae-48f0-ba9d-dd2df772517f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:57.139369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4182b4ee-24ae-48f0-ba9d-dd2df772517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:57.205524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:57.209008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:57.238222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:14:57.239923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e575ddb-16df-4ba5-92fa-4a93301e2fb6 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.240467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e575ddb-16df-4ba5-92fa-4a93301e2fb6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.240965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e575ddb-16df-4ba5-92fa-4a93301e2fb6 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.248413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 35/66] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:57.251006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426addc-b2eb-4eac-96f5-b9152196a428 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.251717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426addc-b2eb-4eac-96f5-b9152196a428 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.252252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426addc-b2eb-4eac-96f5-b9152196a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.256031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d6120-8e26-4bfa-a84e-a2fec305d4fe None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:57.286720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b426addc-b2eb-4eac-96f5-b9152196a428 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:57.288908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b426addc-b2eb-4eac-96f5-b9152196a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:57.292461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57a30c-6891-4d21-92f9-8bb72e2f619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:57.293098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57a30c-6891-4d21-92f9-8bb72e2f619f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.293379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57a30c-6891-4d21-92f9-8bb72e2f619f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.293654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57a30c-6891-4d21-92f9-8bb72e2f619f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.305115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57a30c-6891-4d21-92f9-8bb72e2f619f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-6d57a30c-6891-4d21-92f9-8bb72e2f619f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:14:57.311352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:57.312219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:14:57.312975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 32/67] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:14:57.314106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520654be-e12b-4377-8c76-2e3c87f8ee56 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.314214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520654be-e12b-4377-8c76-2e3c87f8ee56 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.314488 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520654be-e12b-4377-8c76-2e3c87f8ee56 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.318223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 33/68] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:57.318223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520654be-e12b-4377-8c76-2e3c87f8ee56 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.365595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:57.366474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426addc-b2eb-4eac-96f5-b9152196a428 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.424913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520654be-e12b-4377-8c76-2e3c87f8ee56 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:57.441242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:57.458171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e3dd-ac6f-4ef1-a05b-4b789c79e0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:57.458795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e3dd-ac6f-4ef1-a05b-4b789c79e0a5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.459074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e3dd-ac6f-4ef1-a05b-4b789c79e0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.459400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e3dd-ac6f-4ef1-a05b-4b789c79e0a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.467665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426addc-b2eb-4eac-96f5-b9152196a428 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:57.469637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3e3dd-ac6f-4ef1-a05b-4b789c79e0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-bfd3e3dd-ac6f-4ef1-a05b-4b789c79e0a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:14:57.474433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:57.475852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:14:57.476880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 34/70] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:14:57.477716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0190eb2-a194-4edc-9b7b-855866d53be5 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.478002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0190eb2-a194-4edc-9b7b-855866d53be5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.478304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0190eb2-a194-4edc-9b7b-855866d53be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.484471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:57.496403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e0190eb2-a194-4edc-9b7b-855866d53be5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:57.497605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e0190eb2-a194-4edc-9b7b-855866d53be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:57.506099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c088a73-4b09-4faa-aa6e-177085aeea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:57.506758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c088a73-4b09-4faa-aa6e-177085aeea19 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.507045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c088a73-4b09-4faa-aa6e-177085aeea19 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.507322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c088a73-4b09-4faa-aa6e-177085aeea19 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.507979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c088a73-4b09-4faa-aa6e-177085aeea19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:57.508288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c088a73-4b09-4faa-aa6e-177085aeea19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:57.509659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c088a73-4b09-4faa-aa6e-177085aeea19 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:57.517642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 37/71] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:57.518815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f5e-6a20-4877-9f6c-0e581f3c465d None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.519103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f5e-6a20-4877-9f6c-0e581f3c465d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.519377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f5e-6a20-4877-9f6c-0e581f3c465d None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.520848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 38/72] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:14:57.524068 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f9f5e-6a20-4877-9f6c-0e581f3c465d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.566150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 35/73] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:57.566842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0190eb2-a194-4edc-9b7b-855866d53be5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.639938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f9f5e-6a20-4877-9f6c-0e581f3c465d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:57.667071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0190eb2-a194-4edc-9b7b-855866d53be5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:57.673039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe0269-fa16-4fce-9896-d88032cf2501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:57.673664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe0269-fa16-4fce-9896-d88032cf2501 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.673948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe0269-fa16-4fce-9896-d88032cf2501 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.674259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe0269-fa16-4fce-9896-d88032cf2501 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.675547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:57.684798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe0269-fa16-4fce-9896-d88032cf2501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-15fe0269-fa16-4fce-9896-d88032cf2501 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:14:57.690020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:57.690955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 39/74] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:14:57.696864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe0269-fa16-4fce-9896-d88032cf2501 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.708785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b60751-1d11-49b8-93f8-019974be2b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:57.710001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b60751-1d11-49b8-93f8-019974be2b7e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.710321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b60751-1d11-49b8-93f8-019974be2b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.710596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b60751-1d11-49b8-93f8-019974be2b7e None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.711256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b60751-1d11-49b8-93f8-019974be2b7e None admin] RBAC: Adding query filter params (name=member) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:57.711562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b60751-1d11-49b8-93f8-019974be2b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:57.712961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b60751-1d11-49b8-93f8-019974be2b7e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:57.720882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 36/75] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:57.722001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ddd1-6ce0-42ad-873e-8ebb92484f49 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.722319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ddd1-6ce0-42ad-873e-8ebb92484f49 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.722592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ddd1-6ce0-42ad-873e-8ebb92484f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.728083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:57.741476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3094ddd1-6ce0-42ad-873e-8ebb92484f49 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:14:57.742713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3094ddd1-6ce0-42ad-873e-8ebb92484f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:14:57.793428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe0269-fa16-4fce-9896-d88032cf2501 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:57.807301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 37/76] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:14:57.808113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094ddd1-6ce0-42ad-873e-8ebb92484f49 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.827081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f905-8afa-415d-8328-064f5ceeb99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:57.827717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f905-8afa-415d-8328-064f5ceeb99d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.827999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f905-8afa-415d-8328-064f5ceeb99d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.828273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f905-8afa-415d-8328-064f5ceeb99d None admin] PATH_INFO: `/v3/users/3586962b191746b79d7ae426435a3f36` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.829433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f905-8afa-415d-8328-064f5ceeb99d None admin] RBAC: Authorizing `identity:get_user(user_id=3586962b191746b79d7ae426435a3f36)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:57.831200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f905-8afa-415d-8328-064f5ceeb99d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:57.832820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 40/77] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/users/3586962b191746b79d7ae426435a3f36 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:57.833594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f905-8afa-415d-8328-064f5ceeb99d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.913945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:57.917856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094ddd1-6ce0-42ad-873e-8ebb92484f49 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:57.938237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f905-8afa-415d-8328-064f5ceeb99d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:57.939740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:57.950985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b0cf8-296f-4969-b49d-83f4e8da09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:57.951611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0cf8-296f-4969-b49d-83f4e8da09e1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.951895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0cf8-296f-4969-b49d-83f4e8da09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.952170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0cf8-296f-4969-b49d-83f4e8da09e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.962755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b0cf8-296f-4969-b49d-83f4e8da09e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c62b0cf8-296f-4969-b49d-83f4e8da09e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:14:57.967502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:14:57.968366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:14:57.969132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 38/78] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:14:57.969756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b0cf8-296f-4969-b49d-83f4e8da09e1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:57.975532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:57.976150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:57.976593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:57.976881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:57.977547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:57.977856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:57.979295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:57.987641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 41/79] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:57.988220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.073501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b0cf8-296f-4969-b49d-83f4e8da09e1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.087179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c0eba-bb11-41a1-b1de-6767715d9790 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.108496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5bd48-f865-4472-8a18-b74781786318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.109114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5bd48-f865-4472-8a18-b74781786318 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.109394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5bd48-f865-4472-8a18-b74781786318 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.109667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5bd48-f865-4472-8a18-b74781786318 None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.120476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbc09c-c961-4fcd-be39-4d00ce0ef0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.121097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc09c-c961-4fcd-be39-4d00ce0ef0a9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.121380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc09c-c961-4fcd-be39-4d00ce0ef0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.121658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc09c-c961-4fcd-be39-4d00ce0ef0a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.122452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5bd48-f865-4472-8a18-b74781786318 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.122789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbc09c-c961-4fcd-be39-4d00ce0ef0a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.123920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5bd48-f865-4472-8a18-b74781786318 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.124217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbc09c-c961-4fcd-be39-4d00ce0ef0a9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.125503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 39/80] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:58.125900 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 42/81] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:58.126548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbc09c-c961-4fcd-be39-4d00ce0ef0a9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.130675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5bd48-f865-4472-8a18-b74781786318 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.148740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:58.163701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:58.229107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5bd48-f865-4472-8a18-b74781786318 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.233277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbc09c-c961-4fcd-be39-4d00ce0ef0a9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.262433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276325-f683-4165-86f0-5d6ccc63092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.263030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276325-f683-4165-86f0-5d6ccc63092c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.263312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276325-f683-4165-86f0-5d6ccc63092c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.263584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276325-f683-4165-86f0-5d6ccc63092c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.265752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.266384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.266668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.266950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.267604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:58.267912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.269278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.277258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 43/82] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:14:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:58.278041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.334568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab276325-f683-4165-86f0-5d6ccc63092c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.336055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab276325-f683-4165-86f0-5d6ccc63092c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.353336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:58.370649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:58.379187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2c8b-55e9-4834-8088-788dda4efb3f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.411713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7ff39-f2ae-4bb2-b78c-3de6f2a59854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.412852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7ff39-f2ae-4bb2-b78c-3de6f2a59854 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.413139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7ff39-f2ae-4bb2-b78c-3de6f2a59854 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.413475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7ff39-f2ae-4bb2-b78c-3de6f2a59854 None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.414646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7ff39-f2ae-4bb2-b78c-3de6f2a59854 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.416089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7ff39-f2ae-4bb2-b78c-3de6f2a59854 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.417660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 44/83] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:14:58 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:58.422903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7ff39-f2ae-4bb2-b78c-3de6f2a59854 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.433746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 40/84] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:14:58.435708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276325-f683-4165-86f0-5d6ccc63092c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.525989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7ff39-f2ae-4bb2-b78c-3de6f2a59854 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.541360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276325-f683-4165-86f0-5d6ccc63092c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.557746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:58.558573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c1576-65b0-4aec-ab30-643e6fc3f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.559148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1576-65b0-4aec-ab30-643e6fc3f8f6 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.559428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1576-65b0-4aec-ab30-643e6fc3f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.559704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1576-65b0-4aec-ab30-643e6fc3f8f6 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.560335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c1576-65b0-4aec-ab30-643e6fc3f8f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.561763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c1576-65b0-4aec-ab30-643e6fc3f8f6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.576389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055212ea-1a25-4b36-8258-f2e126b83381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.577006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055212ea-1a25-4b36-8258-f2e126b83381 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055212ea-1a25-4b36-8258-f2e126b83381 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.577576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055212ea-1a25-4b36-8258-f2e126b83381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.587906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 45/85] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:14:58 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:14:58.595265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c1576-65b0-4aec-ab30-643e6fc3f8f6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.617806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:58.659426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055212ea-1a25-4b36-8258-f2e126b83381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.660973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055212ea-1a25-4b36-8258-f2e126b83381 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.719867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c1576-65b0-4aec-ab30-643e6fc3f8f6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.766051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe06-05f7-4e29-8b92-c9c8abb283be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.766642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe06-05f7-4e29-8b92-c9c8abb283be None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.767638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe06-05f7-4e29-8b92-c9c8abb283be None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.767638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe06-05f7-4e29-8b92-c9c8abb283be None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.768572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bfe06-05f7-4e29-8b92-c9c8abb283be None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.770030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bfe06-05f7-4e29-8b92-c9c8abb283be None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.772550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 46/86] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:14:58 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:58.773325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe06-05f7-4e29-8b92-c9c8abb283be None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.787102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 41/87] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:14:58.787865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055212ea-1a25-4b36-8258-f2e126b83381 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:58.806976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:58.889628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:58.911963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe06-05f7-4e29-8b92-c9c8abb283be None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.919154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055212ea-1a25-4b36-8258-f2e126b83381 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:58.955826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005953-bc3b-4315-8933-7f062ae8f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.957098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005953-bc3b-4315-8933-7f062ae8f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.957525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005953-bc3b-4315-8933-7f062ae8f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.957712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1257d-77a3-40c8-b8a1-bd0c5b63ceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:58.958384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005953-bc3b-4315-8933-7f062ae8f2f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.958493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1257d-77a3-40c8-b8a1-bd0c5b63ceda None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:58.958853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1257d-77a3-40c8-b8a1-bd0c5b63ceda None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:58.959215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1257d-77a3-40c8-b8a1-bd0c5b63ceda None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:58.960513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1257d-77a3-40c8-b8a1-bd0c5b63ceda None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:58.962032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1257d-77a3-40c8-b8a1-bd0c5b63ceda None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:58.963793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 42/88] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:14:58 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:58.964719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1257d-77a3-40c8-b8a1-bd0c5b63ceda None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:59.053335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:59.059871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9005953-bc3b-4315-8933-7f062ae8f2f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.062251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9005953-bc3b-4315-8933-7f062ae8f2f3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.071623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1257d-77a3-40c8-b8a1-bd0c5b63ceda None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:59.108974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf149e-20b6-47c6-afe3-3605a3ce27e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:59.110234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf149e-20b6-47c6-afe3-3605a3ce27e5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:59.110234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf149e-20b6-47c6-afe3-3605a3ce27e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:59.110421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf149e-20b6-47c6-afe3-3605a3ce27e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:59.178036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:59.182991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf149e-20b6-47c6-afe3-3605a3ce27e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.184696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf149e-20b6-47c6-afe3-3605a3ce27e5 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.199607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 47/89] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:14:59.200980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005953-bc3b-4315-8933-7f062ae8f2f3 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:59.280969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:59.300986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 43/90] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:14:59.305675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf149e-20b6-47c6-afe3-3605a3ce27e5 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:59.336588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005953-bc3b-4315-8933-7f062ae8f2f3 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:59.373839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2440-56b7-4a33-b3be-4ee446ae25aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:59.374530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2440-56b7-4a33-b3be-4ee446ae25aa None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:59.374820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2440-56b7-4a33-b3be-4ee446ae25aa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:59.375101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2440-56b7-4a33-b3be-4ee446ae25aa None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:59.376338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f2440-56b7-4a33-b3be-4ee446ae25aa None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.377907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f2440-56b7-4a33-b3be-4ee446ae25aa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.379753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 48/91] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:14:59 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:59.385164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2440-56b7-4a33-b3be-4ee446ae25aa None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:59.414498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf149e-20b6-47c6-afe3-3605a3ce27e5 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:59.445833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:59.453609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:59.454366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:59.454652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:59.454931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:59.455661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed, user.id=3586962b191746b79d7ae426435a3f36) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:59.455971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.457617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.466005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 44/92] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:14:59 2022] GET /identity/v3/role_assignments?user.id=3586962b191746b79d7ae426435a3f36&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:59.467034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:59.496430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2440-56b7-4a33-b3be-4ee446ae25aa None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:59.523986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:59.536998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567880-d8e4-4674-9594-a02238525f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:59.538276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567880-d8e4-4674-9594-a02238525f5f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:59.538560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567880-d8e4-4674-9594-a02238525f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:59.538833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567880-d8e4-4674-9594-a02238525f5f None admin] PATH_INFO: `/v3/projects/4e01fb42751e4fdd954c871478d32e19` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:59.540117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5567880-d8e4-4674-9594-a02238525f5f None admin] RBAC: Authorizing `identity:get_project(project_id=4e01fb42751e4fdd954c871478d32e19)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.541693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5567880-d8e4-4674-9594-a02238525f5f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.543433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 49/93] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:14:59 2022] GET /identity/v3/projects/4e01fb42751e4fdd954c871478d32e19 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:59.544332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567880-d8e4-4674-9594-a02238525f5f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:59.583359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69f1d-e1f4-4ded-8cdd-a56141322a4e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:59.621929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ccb41-6dcd-4e40-b523-da5a19916f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:59.622717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ccb41-6dcd-4e40-b523-da5a19916f0f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:59.623001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ccb41-6dcd-4e40-b523-da5a19916f0f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:59.623278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ccb41-6dcd-4e40-b523-da5a19916f0f None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:59.624480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ccb41-6dcd-4e40-b523-da5a19916f0f None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.626203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ccb41-6dcd-4e40-b523-da5a19916f0f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.627984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 45/94] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:14:59 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:59.628850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ccb41-6dcd-4e40-b523-da5a19916f0f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:59.659307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567880-d8e4-4674-9594-a02238525f5f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:59.685756 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:59.700563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:59.701353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:59.701736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:59.702190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:59.703117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] RBAC: Adding query filter params (role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed, user.id=d6c1c3430f93463687f21fe4d5ef6201) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:59.703538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.705057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.712090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 50/95] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:14:59 2022] GET /identity/v3/role_assignments?user.id=d6c1c3430f93463687f21fe4d5ef6201&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:59.713071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:14:59.746418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ccb41-6dcd-4e40-b523-da5a19916f0f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:59.765640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:14:59.795020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a11a7-9e51-4a41-8582-21ac0c308f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:59.795661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a11a7-9e51-4a41-8582-21ac0c308f61 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:59.795943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a11a7-9e51-4a41-8582-21ac0c308f61 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:59.796219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a11a7-9e51-4a41-8582-21ac0c308f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:59.796976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a11a7-9e51-4a41-8582-21ac0c308f61 None admin] RBAC: Adding query filter params (role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=4e01fb42751e4fdd954c871478d32e19, user.id=d6c1c3430f93463687f21fe4d5ef6201) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:59.797289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a11a7-9e51-4a41-8582-21ac0c308f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.802048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a11a7-9e51-4a41-8582-21ac0c308f61 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.815554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 46/96] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:14:59 2022] GET /identity/v3/role_assignments?user.id=d6c1c3430f93463687f21fe4d5ef6201&scope.project.id=4e01fb42751e4fdd954c871478d32e19&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:14:59.896416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969687b-9335-4e2b-8226-e8be9a2f5106 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:14:59.953046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f0753-f291-4130-a3dd-6efac0a26de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:14:59.953681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f0753-f291-4130-a3dd-6efac0a26de3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:14:59.953967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f0753-f291-4130-a3dd-6efac0a26de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:14:59.954271 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f0753-f291-4130-a3dd-6efac0a26de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:14:59.955012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f0753-f291-4130-a3dd-6efac0a26de3 None admin] RBAC: Adding query filter params (role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed, user.id=d6c1c3430f93463687f21fe4d5ef6201) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:14:59.955324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f0753-f291-4130-a3dd-6efac0a26de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:14:59.956766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f0753-f291-4130-a3dd-6efac0a26de3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:14:59.965377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 51/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:14:59 2022] GET /identity/v3/role_assignments?user.id=d6c1c3430f93463687f21fe4d5ef6201&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=45f0e969ef594665877c4596781ce6aa => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:01.099290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b682bf-40aa-4452-a152-0d70ab96775d None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:01.099848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b682bf-40aa-4452-a152-0d70ab96775d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:01.099953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b682bf-40aa-4452-a152-0d70ab96775d None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:01.101459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 47/98] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:01.106528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7550-d3fd-438e-93b7-1862acdc9a10 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:01.106931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7550-d3fd-438e-93b7-1862acdc9a10 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:01.107024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7550-d3fd-438e-93b7-1862acdc9a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:01.134289 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e78f7550-d3fd-438e-93b7-1862acdc9a10 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:01.135472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e78f7550-d3fd-438e-93b7-1862acdc9a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:01.202122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:01.231404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:01.266441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b682bf-40aa-4452-a152-0d70ab96775d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:01.384942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1778-9f3f-4cfd-8f5f-ff03d9b5312b None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:01.385128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1778-9f3f-4cfd-8f5f-ff03d9b5312b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:01.385407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1778-9f3f-4cfd-8f5f-ff03d9b5312b None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:01.387198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 53/100] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:01.394464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0653c-059c-43ed-bcbd-97814b884774 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:01.394743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0653c-059c-43ed-bcbd-97814b884774 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:01.395023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0653c-059c-43ed-bcbd-97814b884774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:01.404218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b682bf-40aa-4452-a152-0d70ab96775d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:01.417840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f3b0653c-059c-43ed-bcbd-97814b884774 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:01.420021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f3b0653c-059c-43ed-bcbd-97814b884774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:01.458798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105e3e1-7c51-44db-b3ac-39f1c63e01d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:01.459466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105e3e1-7c51-44db-b3ac-39f1c63e01d7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:01.459752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105e3e1-7c51-44db-b3ac-39f1c63e01d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:01.460028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105e3e1-7c51-44db-b3ac-39f1c63e01d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:01.479737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105e3e1-7c51-44db-b3ac-39f1c63e01d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c105e3e1-7c51-44db-b3ac-39f1c63e01d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:01.484715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:01.485569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:01.486704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 48/101] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:01.492380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105e3e1-7c51-44db-b3ac-39f1c63e01d7 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:01.503726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 54/102] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:01.530605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0653c-059c-43ed-bcbd-97814b884774 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:01.569471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:01.665172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0653c-059c-43ed-bcbd-97814b884774 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:01.673649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105e3e1-7c51-44db-b3ac-39f1c63e01d7 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:01.694419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:01.735400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054733db-85fa-4ad4-b97d-2a96b2b7f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:01.736043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054733db-85fa-4ad4-b97d-2a96b2b7f748 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:01.736322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054733db-85fa-4ad4-b97d-2a96b2b7f748 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:01.736596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054733db-85fa-4ad4-b97d-2a96b2b7f748 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:01.738797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054733db-85fa-4ad4-b97d-2a96b2b7f748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:01.740787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054733db-85fa-4ad4-b97d-2a96b2b7f748 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:01.740910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:01.741432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:01.741709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:01.741981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:01.742719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:01.742835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 55/103] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:01.743027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:01.744398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:01.754990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054733db-85fa-4ad4-b97d-2a96b2b7f748 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:01.759007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 49/104] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:01.766935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:01.964515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054733db-85fa-4ad4-b97d-2a96b2b7f748 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:01.977196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee32fb-8578-4f25-9237-f44002d3d3f3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:01.982236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:02.027420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf765b-c7e6-4471-9fc6-38c0b9e01328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:02.028058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf765b-c7e6-4471-9fc6-38c0b9e01328 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.028336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf765b-c7e6-4471-9fc6-38c0b9e01328 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.028607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf765b-c7e6-4471-9fc6-38c0b9e01328 None admin] PATH_INFO: `/v3/users/fc8547e646f8419b98784436701cfada` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.044166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf765b-c7e6-4471-9fc6-38c0b9e01328 None admin] RBAC: Authorizing `identity:get_user(user_id=fc8547e646f8419b98784436701cfada)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:02.045664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf765b-c7e6-4471-9fc6-38c0b9e01328 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:02.047584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 50/105] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:01 2022] GET /identity/v3/users/fc8547e646f8419b98784436701cfada => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:02.053187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf765b-c7e6-4471-9fc6-38c0b9e01328 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:02.067845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb21c59-469c-476a-b15a-c4f5b1bc2488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:02.068993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21c59-469c-476a-b15a-c4f5b1bc2488 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.069327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21c59-469c-476a-b15a-c4f5b1bc2488 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.069601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21c59-469c-476a-b15a-c4f5b1bc2488 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.072448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb21c59-469c-476a-b15a-c4f5b1bc2488 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:02.073895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb21c59-469c-476a-b15a-c4f5b1bc2488 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:02.139855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 56/106] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:15:01 2022] POST /identity/v3/projects => generated 302 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:02.194515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf765b-c7e6-4471-9fc6-38c0b9e01328 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:02.244100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba38083-4261-4ef3-ac73-b7d0ba8755be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:02.245102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38083-4261-4ef3-ac73-b7d0ba8755be None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.245584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38083-4261-4ef3-ac73-b7d0ba8755be None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.246056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38083-4261-4ef3-ac73-b7d0ba8755be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.278751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:02.299762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad164-530e-4044-9f64-cfe8c696f3d1 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.299762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad164-530e-4044-9f64-cfe8c696f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.299762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad164-530e-4044-9f64-cfe8c696f3d1 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.300269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 57/107] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:02.310096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353397-abbe-4ceb-bdbc-4e87a7adc7d8 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.310096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353397-abbe-4ceb-bdbc-4e87a7adc7d8 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.310096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353397-abbe-4ceb-bdbc-4e87a7adc7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.333091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba38083-4261-4ef3-ac73-b7d0ba8755be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:02.339804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba38083-4261-4ef3-ac73-b7d0ba8755be None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:02.350856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9d353397-abbe-4ceb-bdbc-4e87a7adc7d8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:02.351959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9d353397-abbe-4ceb-bdbc-4e87a7adc7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:02.401874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:02.494369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 51/108] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:02.495262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 58/109] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:02.496335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f2ce5-502e-44a2-aec4-a1031f9addc0 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.496874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f2ce5-502e-44a2-aec4-a1031f9addc0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.497362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f2ce5-502e-44a2-aec4-a1031f9addc0 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.499127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 52/110] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:02.504421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28453b9-6763-474c-a935-60a92dcb501a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.504707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28453b9-6763-474c-a935-60a92dcb501a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.504983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28453b9-6763-474c-a935-60a92dcb501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.505201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f2ce5-502e-44a2-aec4-a1031f9addc0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:02.528727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b28453b9-6763-474c-a935-60a92dcb501a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:02.529908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b28453b9-6763-474c-a935-60a92dcb501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:02.587843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:02.621343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 59/111] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:02.622669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28453b9-6763-474c-a935-60a92dcb501a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:02.636407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f2ce5-502e-44a2-aec4-a1031f9addc0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:02.683584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f15fe-84d4-498d-b8f4-890cbcdd818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:02.684215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f15fe-84d4-498d-b8f4-890cbcdd818f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.684565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f15fe-84d4-498d-b8f4-890cbcdd818f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.684906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f15fe-84d4-498d-b8f4-890cbcdd818f None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.686179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f15fe-84d4-498d-b8f4-890cbcdd818f None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:02.687972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f15fe-84d4-498d-b8f4-890cbcdd818f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:02.689993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 53/112] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:02 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:02.690922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f15fe-84d4-498d-b8f4-890cbcdd818f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:02.744082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:02.758352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28453b9-6763-474c-a935-60a92dcb501a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:02.804509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20b13-83b9-4b55-b2f2-c88c51fa295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:02.805724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20b13-83b9-4b55-b2f2-c88c51fa295d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.806266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20b13-83b9-4b55-b2f2-c88c51fa295d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.807167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20b13-83b9-4b55-b2f2-c88c51fa295d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.812266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f15fe-84d4-498d-b8f4-890cbcdd818f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:02.822918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f20b13-83b9-4b55-b2f2-c88c51fa295d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-f1f20b13-83b9-4b55-b2f2-c88c51fa295d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:02.830286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:02.831150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:02.831903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:02.839606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 60/113] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:02.839606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20b13-83b9-4b55-b2f2-c88c51fa295d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:02.848775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:02.858106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bcd15-61de-4ff9-97b4-949c73cd03af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:02.858866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bcd15-61de-4ff9-97b4-949c73cd03af None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:02.859134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bcd15-61de-4ff9-97b4-949c73cd03af None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:02.859412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bcd15-61de-4ff9-97b4-949c73cd03af None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:02.871414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bcd15-61de-4ff9-97b4-949c73cd03af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-4c0bcd15-61de-4ff9-97b4-949c73cd03af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:02.876587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:02.877502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:02.878424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 54/114] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:02.884945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bcd15-61de-4ff9-97b4-949c73cd03af None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.016809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20b13-83b9-4b55-b2f2-c88c51fa295d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:03.058654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bcd15-61de-4ff9-97b4-949c73cd03af None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:03.084648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:03.086181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.086472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.086744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.087469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] RBAC: Adding query filter params (role.id=8a7ad38a846e4411ac1dcc42523f6085, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed, user.id=fc8547e646f8419b98784436701cfada) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:03.087777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:03.090293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:03.104602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 61/115] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:02 2022] GET /identity/v3/role_assignments?user.id=fc8547e646f8419b98784436701cfada&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=8a7ad38a846e4411ac1dcc42523f6085 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:03.106489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.134370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ee1f9-53de-49d9-ab26-2d0428569a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:03.134986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee1f9-53de-49d9-ab26-2d0428569a73 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.135267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee1f9-53de-49d9-ab26-2d0428569a73 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.135535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee1f9-53de-49d9-ab26-2d0428569a73 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.136239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee1f9-53de-49d9-ab26-2d0428569a73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:03.136546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee1f9-53de-49d9-ab26-2d0428569a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:03.137930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee1f9-53de-49d9-ab26-2d0428569a73 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:03.148046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:03.158292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 55/116] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:03.159389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ed58-f1d3-4088-bda2-88fa18525cd2 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.159681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ed58-f1d3-4088-bda2-88fa18525cd2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.159954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ed58-f1d3-4088-bda2-88fa18525cd2 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.161158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 56/117] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:03.167209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4ed58-f1d3-4088-bda2-88fa18525cd2 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.249299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d7ca7-19b5-4e89-980b-e5598b5db6d5 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:03.289629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25ae79-5e7b-4c88-8d18-abdce67055ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:03.290857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25ae79-5e7b-4c88-8d18-abdce67055ba None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.291343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25ae79-5e7b-4c88-8d18-abdce67055ba None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.291845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25ae79-5e7b-4c88-8d18-abdce67055ba None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.292724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25ae79-5e7b-4c88-8d18-abdce67055ba None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:03.293306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25ae79-5e7b-4c88-8d18-abdce67055ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:03.295586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25ae79-5e7b-4c88-8d18-abdce67055ba None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:03.306794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:03.307895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 62/118] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:03.309435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ee8f-b3b9-4a22-9623-9aae546e3b80 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.310728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ee8f-b3b9-4a22-9623-9aae546e3b80 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.311214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ee8f-b3b9-4a22-9623-9aae546e3b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.332920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-2220ee8f-b3b9-4a22-9623-9aae546e3b80 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:03.334767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2220ee8f-b3b9-4a22-9623-9aae546e3b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:03.411266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4ed58-f1d3-4088-bda2-88fa18525cd2 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:03.426549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 63/119] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:03.427422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220ee8f-b3b9-4a22-9623-9aae546e3b80 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.439112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:03.531329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08f62-cbdc-411e-bc7d-7cd8cb2593f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:03.531975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08f62-cbdc-411e-bc7d-7cd8cb2593f0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.532258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08f62-cbdc-411e-bc7d-7cd8cb2593f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.532532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08f62-cbdc-411e-bc7d-7cd8cb2593f0 None admin] PATH_INFO: `/v3/users/3586962b191746b79d7ae426435a3f36` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.533682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc08f62-cbdc-411e-bc7d-7cd8cb2593f0 None admin] RBAC: Authorizing `identity:get_user(user_id=3586962b191746b79d7ae426435a3f36)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:03.534781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220ee8f-b3b9-4a22-9623-9aae546e3b80 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:03.535164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc08f62-cbdc-411e-bc7d-7cd8cb2593f0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:03.536752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 57/120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:03 2022] GET /identity/v3/users/3586962b191746b79d7ae426435a3f36 => generated 247 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:03.538144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08f62-cbdc-411e-bc7d-7cd8cb2593f0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.580207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648728a4-72c0-4b34-ac7b-85bacaff4c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:03.580775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648728a4-72c0-4b34-ac7b-85bacaff4c48 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.581220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648728a4-72c0-4b34-ac7b-85bacaff4c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.581504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648728a4-72c0-4b34-ac7b-85bacaff4c48 None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.583101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648728a4-72c0-4b34-ac7b-85bacaff4c48 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:03.584578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648728a4-72c0-4b34-ac7b-85bacaff4c48 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:03.586202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 64/121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:03 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:03.587425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494ba2c-7d17-4b01-b1e8-63253c479e81 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.587715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494ba2c-7d17-4b01-b1e8-63253c479e81 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.587987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494ba2c-7d17-4b01-b1e8-63253c479e81 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.593230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 65/122] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:03.593230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494ba2c-7d17-4b01-b1e8-63253c479e81 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.679227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08f62-cbdc-411e-bc7d-7cd8cb2593f0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:03.681467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:03.705986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:03.714246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494ba2c-7d17-4b01-b1e8-63253c479e81 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:03.728269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae336-48c6-4d58-9558-4ce5f75c23a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:03.729124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae336-48c6-4d58-9558-4ce5f75c23a1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.729868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae336-48c6-4d58-9558-4ce5f75c23a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.730320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae336-48c6-4d58-9558-4ce5f75c23a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.746114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ae336-48c6-4d58-9558-4ce5f75c23a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-970ae336-48c6-4d58-9558-4ce5f75c23a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:03.751941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:03.752975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:03.753917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:03.756040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 58/123] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:03.757072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae336-48c6-4d58-9558-4ce5f75c23a1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.757831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838a232-6188-421d-ac0c-6f74e831e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:03.758695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a232-6188-421d-ac0c-6f74e831e002 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.759148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a232-6188-421d-ac0c-6f74e831e002 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.759581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a232-6188-421d-ac0c-6f74e831e002 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.762178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838a232-6188-421d-ac0c-6f74e831e002 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:03.763840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838a232-6188-421d-ac0c-6f74e831e002 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:03.765779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 66/124] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:03 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:03.767232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994fbb-063a-43a7-be58-7b6ab6dc20b5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.767726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994fbb-063a-43a7-be58-7b6ab6dc20b5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.768131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994fbb-063a-43a7-be58-7b6ab6dc20b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.792143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-24994fbb-063a-43a7-be58-7b6ab6dc20b5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:03.794155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-24994fbb-063a-43a7-be58-7b6ab6dc20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:03.878936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae336-48c6-4d58-9558-4ce5f75c23a1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:03.896160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 67/125] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:03.899120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994fbb-063a-43a7-be58-7b6ab6dc20b5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.938224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14110d-a279-4a08-93b6-526167431f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:03.939346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14110d-a279-4a08-93b6-526167431f28 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:03.939705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14110d-a279-4a08-93b6-526167431f28 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:03.940075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14110d-a279-4a08-93b6-526167431f28 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:03.941887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14110d-a279-4a08-93b6-526167431f28 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:03.944308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14110d-a279-4a08-93b6-526167431f28 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:03.946487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 59/126] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:03 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:03.948262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14110d-a279-4a08-93b6-526167431f28 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:03.993047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:04.015852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:04.029441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994fbb-063a-43a7-be58-7b6ab6dc20b5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.079248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.080241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.080685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.081480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.082526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:04.082909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:04.085048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:04.087597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14110d-a279-4a08-93b6-526167431f28 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.096092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 68/127] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:04.096923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:04.124753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44759-98b9-4ac7-bbf3-8bbe6d4a289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.125742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44759-98b9-4ac7-bbf3-8bbe6d4a289f None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.126270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44759-98b9-4ac7-bbf3-8bbe6d4a289f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.126747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44759-98b9-4ac7-bbf3-8bbe6d4a289f None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/users/3586962b191746b79d7ae426435a3f36/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.128868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d44759-98b9-4ac7-bbf3-8bbe6d4a289f None admin] RBAC: Authorizing `identity:create_grant(project_id=ea16686f0e7343b88fa1696b8b1715ed, user_id=3586962b191746b79d7ae426435a3f36, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:04.130961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d44759-98b9-4ac7-bbf3-8bbe6d4a289f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:04.148379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 60/128] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:03 2022] PUT /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/users/3586962b191746b79d7ae426435a3f36/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:04.149501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44759-98b9-4ac7-bbf3-8bbe6d4a289f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:04.220882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef1858-5a3d-432f-9219-26c0d3ef08de None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.261666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1711-5fa5-4d58-a1aa-b77c75695f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.262398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1711-5fa5-4d58-a1aa-b77c75695f72 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.262686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1711-5fa5-4d58-a1aa-b77c75695f72 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.262966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1711-5fa5-4d58-a1aa-b77c75695f72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.265285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:04.269731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44759-98b9-4ac7-bbf3-8bbe6d4a289f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.277149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1711-5fa5-4d58-a1aa-b77c75695f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:04.279781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-583b1711-5fa5-4d58-a1aa-b77c75695f72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:04.283644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:04.284480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:04.285228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:04.289672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 69/129] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:04.290611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1711-5fa5-4d58-a1aa-b77c75695f72 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:04.331799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ddb19-fe99-4fbe-81a2-f417922198bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.332492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ddb19-fe99-4fbe-81a2-f417922198bb None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.332768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ddb19-fe99-4fbe-81a2-f417922198bb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.333057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ddb19-fe99-4fbe-81a2-f417922198bb None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/users/d6c1c3430f93463687f21fe4d5ef6201/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.335162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ddb19-fe99-4fbe-81a2-f417922198bb None admin] RBAC: Authorizing `identity:create_grant(project_id=ea16686f0e7343b88fa1696b8b1715ed, user_id=d6c1c3430f93463687f21fe4d5ef6201, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:04.336658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ddb19-fe99-4fbe-81a2-f417922198bb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:04.368796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 61/130] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:04 2022] PUT /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/users/d6c1c3430f93463687f21fe4d5ef6201/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:04.369506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ddb19-fe99-4fbe-81a2-f417922198bb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:04.423661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1711-5fa5-4d58-a1aa-b77c75695f72 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.464127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e4fb-19c6-4992-bdad-e4b72b6db6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.464812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e4fb-19c6-4992-bdad-e4b72b6db6d0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.465225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e4fb-19c6-4992-bdad-e4b72b6db6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.465540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e4fb-19c6-4992-bdad-e4b72b6db6d0 None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.467408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8e4fb-19c6-4992-bdad-e4b72b6db6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:04.469306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8e4fb-19c6-4992-bdad-e4b72b6db6d0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:04.471887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 70/131] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:04 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:04.477197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e4fb-19c6-4992-bdad-e4b72b6db6d0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:04.562531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:04.597916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ddb19-fe99-4fbe-81a2-f417922198bb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.603087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e4fb-19c6-4992-bdad-e4b72b6db6d0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.641368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424624bc-4431-4a73-b087-551671872238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.642012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424624bc-4431-4a73-b087-551671872238 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.642334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424624bc-4431-4a73-b087-551671872238 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.642614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424624bc-4431-4a73-b087-551671872238 None admin] PATH_INFO: `/v3/projects/4e01fb42751e4fdd954c871478d32e19` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.643775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424624bc-4431-4a73-b087-551671872238 None admin] RBAC: Authorizing `identity:get_project(project_id=4e01fb42751e4fdd954c871478d32e19)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:04.645499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424624bc-4431-4a73-b087-551671872238 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:04.648104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 71/132] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:04 2022] GET /identity/v3/projects/4e01fb42751e4fdd954c871478d32e19 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:04.653782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424624bc-4431-4a73-b087-551671872238 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:04.657547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.658199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.658485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.658765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.659437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:04.659742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:04.661143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:04.674195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 62/133] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:04.695144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:04.756677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:04.766389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424624bc-4431-4a73-b087-551671872238 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.803334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67995ec-7177-4eba-a696-0f89e6da7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.804138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67995ec-7177-4eba-a696-0f89e6da7200 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.804432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67995ec-7177-4eba-a696-0f89e6da7200 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.804718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67995ec-7177-4eba-a696-0f89e6da7200 None admin] PATH_INFO: `/v3/projects/4e01fb42751e4fdd954c871478d32e19/users/d6c1c3430f93463687f21fe4d5ef6201/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.806738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67995ec-7177-4eba-a696-0f89e6da7200 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e01fb42751e4fdd954c871478d32e19, user_id=d6c1c3430f93463687f21fe4d5ef6201, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:04.808216 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67995ec-7177-4eba-a696-0f89e6da7200 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:04.813918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:04.836744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 72/134] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:04 2022] PUT /identity/v3/projects/4e01fb42751e4fdd954c871478d32e19/users/d6c1c3430f93463687f21fe4d5ef6201/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:04.898357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f198-e98f-4ff6-9fae-cec5b80b6ea5 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:04.956328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844efc9-3c52-473c-8d57-a4da5d9e23ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:04.956886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844efc9-3c52-473c-8d57-a4da5d9e23ff None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.957167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844efc9-3c52-473c-8d57-a4da5d9e23ff None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.957441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844efc9-3c52-473c-8d57-a4da5d9e23ff None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.958619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844efc9-3c52-473c-8d57-a4da5d9e23ff None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:04.960815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844efc9-3c52-473c-8d57-a4da5d9e23ff None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:04.962507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 63/135] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:04 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:04.968230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67995ec-7177-4eba-a696-0f89e6da7200 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:04.992055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760aff7-5965-4ace-8e75-8ec68550a194 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.992346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760aff7-5965-4ace-8e75-8ec68550a194 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:04.992624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760aff7-5965-4ace-8e75-8ec68550a194 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:04.994131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 64/136] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:04.999562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130c3f-e33c-4775-be92-6d93f6134477 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:04.999938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130c3f-e33c-4775-be92-6d93f6134477 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:05.000225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130c3f-e33c-4775-be92-6d93f6134477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:05.035104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a3130c3f-e33c-4775-be92-6d93f6134477 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:05.036988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a3130c3f-e33c-4775-be92-6d93f6134477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:05.155383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67995ec-7177-4eba-a696-0f89e6da7200 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:05.168971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 65/137] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:05.197865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130c3f-e33c-4775-be92-6d93f6134477 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:05.222595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efa778-5a61-4017-a2e4-85e36c104eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:05.223954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efa778-5a61-4017-a2e4-85e36c104eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:05.224469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efa778-5a61-4017-a2e4-85e36c104eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:05.224981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efa778-5a61-4017-a2e4-85e36c104eb5 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:05.226409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efa778-5a61-4017-a2e4-85e36c104eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:05.228234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efa778-5a61-4017-a2e4-85e36c104eb5 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:05.230114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 73/138] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:04 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:05.236468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:05.238106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efa778-5a61-4017-a2e4-85e36c104eb5 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:05.321220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130c3f-e33c-4775-be92-6d93f6134477 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:05.378716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:05.384442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1592c-c292-4f13-b8db-4f9e15b8ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:05.385139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1592c-c292-4f13-b8db-4f9e15b8ae3a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:05.385432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1592c-c292-4f13-b8db-4f9e15b8ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:05.385711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1592c-c292-4f13-b8db-4f9e15b8ae3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:05.386905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1592c-c292-4f13-b8db-4f9e15b8ae3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:05.388633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1592c-c292-4f13-b8db-4f9e15b8ae3a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:05.397171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 66/139] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:05.398234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1592c-c292-4f13-b8db-4f9e15b8ae3a None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:05.448256 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efa778-5a61-4017-a2e4-85e36c104eb5 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:05.516734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a228d42-7fd8-4f4c-bee5-fc81b089a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:05.517346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228d42-7fd8-4f4c-bee5-fc81b089a620 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:05.517636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228d42-7fd8-4f4c-bee5-fc81b089a620 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:05.517913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228d42-7fd8-4f4c-bee5-fc81b089a620 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/users/d6c1c3430f93463687f21fe4d5ef6201/roles/45f0e969ef594665877c4596781ce6aa` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:05.528972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a228d42-7fd8-4f4c-bee5-fc81b089a620 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea16686f0e7343b88fa1696b8b1715ed, user_id=d6c1c3430f93463687f21fe4d5ef6201, role_id=45f0e969ef594665877c4596781ce6aa)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:05.530492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a228d42-7fd8-4f4c-bee5-fc81b089a620 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:05.560618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 74/140] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:05 2022] PUT /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/users/d6c1c3430f93463687f21fe4d5ef6201/roles/45f0e969ef594665877c4596781ce6aa => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:15:05.591875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:05.604181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1592c-c292-4f13-b8db-4f9e15b8ae3a None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:05.658776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72743d63-f9b4-4ba5-8c7a-d122f986b241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:05.659906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743d63-f9b4-4ba5-8c7a-d122f986b241 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:05.660396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743d63-f9b4-4ba5-8c7a-d122f986b241 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:05.660876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743d63-f9b4-4ba5-8c7a-d122f986b241 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:05.661780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72743d63-f9b4-4ba5-8c7a-d122f986b241 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:05.663562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72743d63-f9b4-4ba5-8c7a-d122f986b241 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:05.695416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 67/141] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:05 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:05.954647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655b56-4950-4241-bfcd-d763ed58d904 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:05.954995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655b56-4950-4241-bfcd-d763ed58d904 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:05.955227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655b56-4950-4241-bfcd-d763ed58d904 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:05.956593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 75/142] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:05.962429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b962efb-4a50-497c-b96f-ec566cf218c3 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:05.962720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b962efb-4a50-497c-b96f-ec566cf218c3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:05.963001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b962efb-4a50-497c-b96f-ec566cf218c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:05.982324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3b962efb-4a50-497c-b96f-ec566cf218c3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:05.983524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3b962efb-4a50-497c-b96f-ec566cf218c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:06.065547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 68/143] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:06.102738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a655b56-4950-4241-bfcd-d763ed58d904 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:06.223029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a655b56-4950-4241-bfcd-d763ed58d904 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:06.243749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:06.269269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577f0b6-efaf-4c59-a19f-b51a73893e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:06.269957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577f0b6-efaf-4c59-a19f-b51a73893e13 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:06.270541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577f0b6-efaf-4c59-a19f-b51a73893e13 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:06.270818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577f0b6-efaf-4c59-a19f-b51a73893e13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:06.288167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577f0b6-efaf-4c59-a19f-b51a73893e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-2577f0b6-efaf-4c59-a19f-b51a73893e13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:06.292977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:06.293859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:06.295073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 76/144] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:06.301796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b962efb-4a50-497c-b96f-ec566cf218c3 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:06.390947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:06.413586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b962efb-4a50-497c-b96f-ec566cf218c3 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:06.451455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:06.452118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:06.452404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:06.452678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:06.453346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:06.453652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:06.455081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:06.465971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 69/145] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:06.471536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577f0b6-efaf-4c59-a19f-b51a73893e13 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:06.578370 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577f0b6-efaf-4c59-a19f-b51a73893e13 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:06.616019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf3d4-d2e3-4ac9-9d6e-79c3f7d1d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:06.616648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf3d4-d2e3-4ac9-9d6e-79c3f7d1d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:06.616933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf3d4-d2e3-4ac9-9d6e-79c3f7d1d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:06.617207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf3d4-d2e3-4ac9-9d6e-79c3f7d1d4a4 None admin] PATH_INFO: `/v3/users/fc8547e646f8419b98784436701cfada` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:06.618358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaf3d4-d2e3-4ac9-9d6e-79c3f7d1d4a4 None admin] RBAC: Authorizing `identity:get_user(user_id=fc8547e646f8419b98784436701cfada)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:06.619803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaf3d4-d2e3-4ac9-9d6e-79c3f7d1d4a4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:06.621751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 77/146] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:06 2022] GET /identity/v3/users/fc8547e646f8419b98784436701cfada => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:06.627379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:06.748765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd29ab-b740-43fe-9653-98dc2f596c51 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:06.784953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc186142-cd4c-4379-9ad5-4f79de4f16c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:06.785582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186142-cd4c-4379-9ad5-4f79de4f16c1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:06.785862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186142-cd4c-4379-9ad5-4f79de4f16c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:06.786164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186142-cd4c-4379-9ad5-4f79de4f16c1 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:06.787404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc186142-cd4c-4379-9ad5-4f79de4f16c1 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:06.788869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc186142-cd4c-4379-9ad5-4f79de4f16c1 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:06.790844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 70/147] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:06 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:06.796545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf3d4-d2e3-4ac9-9d6e-79c3f7d1d4a4 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:06.848210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:06.925941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf3d4-d2e3-4ac9-9d6e-79c3f7d1d4a4 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:06.970491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525045-0121-4028-a62e-e92a3ffada10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:06.971160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525045-0121-4028-a62e-e92a3ffada10 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:06.971439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525045-0121-4028-a62e-e92a3ffada10 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:06.971715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525045-0121-4028-a62e-e92a3ffada10 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/users/fc8547e646f8419b98784436701cfada/roles/8a7ad38a846e4411ac1dcc42523f6085` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:06.977081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3525045-0121-4028-a62e-e92a3ffada10 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea16686f0e7343b88fa1696b8b1715ed, user_id=fc8547e646f8419b98784436701cfada, role_id=8a7ad38a846e4411ac1dcc42523f6085)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:06.978632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3525045-0121-4028-a62e-e92a3ffada10 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:06.997749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 78/148] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:06 2022] PUT /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/users/fc8547e646f8419b98784436701cfada/roles/8a7ad38a846e4411ac1dcc42523f6085 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:07.049147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4348a-b244-4dc4-b6d8-68644c8c1600 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:07.049472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4348a-b244-4dc4-b6d8-68644c8c1600 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:07.049701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4348a-b244-4dc4-b6d8-68644c8c1600 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:07.051157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 71/149] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:07.056871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c487c-6065-40d3-9a67-75baf7138228 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:07.057165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c487c-6065-40d3-9a67-75baf7138228 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:07.057445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c487c-6065-40d3-9a67-75baf7138228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:07.084250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-5e7c487c-6065-40d3-9a67-75baf7138228 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:07.085467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5e7c487c-6065-40d3-9a67-75baf7138228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:07.168127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 79/150] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:07.210753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4348a-b244-4dc4-b6d8-68644c8c1600 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:07.225097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:07.346251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4348a-b244-4dc4-b6d8-68644c8c1600 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:07.387265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0033b-1741-4199-9c26-d95b2a07c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:07.387897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0033b-1741-4199-9c26-d95b2a07c969 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:07.388175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0033b-1741-4199-9c26-d95b2a07c969 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:07.388447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0033b-1741-4199-9c26-d95b2a07c969 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:07.401475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0033b-1741-4199-9c26-d95b2a07c969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-82a0033b-1741-4199-9c26-d95b2a07c969 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:07.406652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:07.407493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:07.408662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 72/151] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:07.414314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c487c-6065-40d3-9a67-75baf7138228 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:07.466556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:07.545918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c487c-6065-40d3-9a67-75baf7138228 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:07.586675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804f3d2-e96e-41f2-8227-77d4fbf1ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:07.587345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804f3d2-e96e-41f2-8227-77d4fbf1ea41 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:07.587626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804f3d2-e96e-41f2-8227-77d4fbf1ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:07.587955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804f3d2-e96e-41f2-8227-77d4fbf1ea41 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:07.588629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804f3d2-e96e-41f2-8227-77d4fbf1ea41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:07.588937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804f3d2-e96e-41f2-8227-77d4fbf1ea41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:07.590354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804f3d2-e96e-41f2-8227-77d4fbf1ea41 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:07.602577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 80/152] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:07.608098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0033b-1741-4199-9c26-d95b2a07c969 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:07.698348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:07.733446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0033b-1741-4199-9c26-d95b2a07c969 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:07.765398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c743b-3a83-4f0c-a946-d8295fc4e069 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:07.765724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c743b-3a83-4f0c-a946-d8295fc4e069 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:07.765953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c743b-3a83-4f0c-a946-d8295fc4e069 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:07.767593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 81/153] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:07.774285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17403d-7637-4a0b-901f-ec2e63b6ac20 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:07.774570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17403d-7637-4a0b-901f-ec2e63b6ac20 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:07.774846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17403d-7637-4a0b-901f-ec2e63b6ac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:07.778676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02715f-8b23-4c8e-b3cc-cded14aea3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:07.779307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02715f-8b23-4c8e-b3cc-cded14aea3f4 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:07.779583 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02715f-8b23-4c8e-b3cc-cded14aea3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:07.779852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02715f-8b23-4c8e-b3cc-cded14aea3f4 None admin] PATH_INFO: `/v3/users/3586962b191746b79d7ae426435a3f36` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:07.782763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02715f-8b23-4c8e-b3cc-cded14aea3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=3586962b191746b79d7ae426435a3f36)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:07.784228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02715f-8b23-4c8e-b3cc-cded14aea3f4 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:07.786119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 73/154] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:07 2022] GET /identity/v3/users/3586962b191746b79d7ae426435a3f36 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:07.791558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02715f-8b23-4c8e-b3cc-cded14aea3f4 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:07.812914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4f17403d-7637-4a0b-901f-ec2e63b6ac20 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:07.814244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4f17403d-7637-4a0b-901f-ec2e63b6ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:07.958225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02715f-8b23-4c8e-b3cc-cded14aea3f4 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:07.966089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 82/155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:08.002169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17403d-7637-4a0b-901f-ec2e63b6ac20 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:08.025090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4682adf-0c8a-4e0e-b88a-9c55c0591182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:08.026082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4682adf-0c8a-4e0e-b88a-9c55c0591182 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:08.026560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4682adf-0c8a-4e0e-b88a-9c55c0591182 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:08.027035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4682adf-0c8a-4e0e-b88a-9c55c0591182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:08.043745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:08.053867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:08.183833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17403d-7637-4a0b-901f-ec2e63b6ac20 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:08.207107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4682adf-0c8a-4e0e-b88a-9c55c0591182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:08.208638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4682adf-0c8a-4e0e-b88a-9c55c0591182 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:08.248801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740e86a-fec4-4993-8d1c-4089883f6df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:08.249441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740e86a-fec4-4993-8d1c-4089883f6df7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:08.249722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740e86a-fec4-4993-8d1c-4089883f6df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:08.249994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740e86a-fec4-4993-8d1c-4089883f6df7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:08.272572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740e86a-fec4-4993-8d1c-4089883f6df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-3740e86a-fec4-4993-8d1c-4089883f6df7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:08.278382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:08.279392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:08.280232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 83/156] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:08.288112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740e86a-fec4-4993-8d1c-4089883f6df7 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:08.433245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:08.452989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 74/157] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:15:08.459050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4682adf-0c8a-4e0e-b88a-9c55c0591182 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:08.468731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740e86a-fec4-4993-8d1c-4089883f6df7 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:08.539923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:08.540923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:08.541346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:08.541623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:08.542321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:08.542629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:08.544211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:08.561976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 84/158] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:08.562540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:08.567885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:08.713912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4682adf-0c8a-4e0e-b88a-9c55c0591182 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:08.754481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616c694-2581-442f-9464-d729adb4e7e5 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:08.776817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db77ea5-32cf-4f32-9820-732d54f139a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:08.777463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db77ea5-32cf-4f32-9820-732d54f139a9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:08.777738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db77ea5-32cf-4f32-9820-732d54f139a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:08.778008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db77ea5-32cf-4f32-9820-732d54f139a9 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:08.779411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db77ea5-32cf-4f32-9820-732d54f139a9 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:08.780915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db77ea5-32cf-4f32-9820-732d54f139a9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:08.782704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 75/159] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:08 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:08.783918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b594cc-97c6-43ae-a8dc-87a75e6eccbf None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:08.784197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b594cc-97c6-43ae-a8dc-87a75e6eccbf None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:08.784470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b594cc-97c6-43ae-a8dc-87a75e6eccbf None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:08.785932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 76/160] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:08.795209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b594cc-97c6-43ae-a8dc-87a75e6eccbf None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:08.830022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c30fe-1017-4cdb-9549-9f7e11de5749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:08.830679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c30fe-1017-4cdb-9549-9f7e11de5749 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:08.830955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c30fe-1017-4cdb-9549-9f7e11de5749 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:08.831222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c30fe-1017-4cdb-9549-9f7e11de5749 None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:08.833316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c30fe-1017-4cdb-9549-9f7e11de5749 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:08.834923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c30fe-1017-4cdb-9549-9f7e11de5749 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:08.836575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 85/161] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:08 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:08.837702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63767a-4b92-439b-812e-e3fae7335ca4 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:08.837990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63767a-4b92-439b-812e-e3fae7335ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:08.838295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63767a-4b92-439b-812e-e3fae7335ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:08.877647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ec63767a-4b92-439b-812e-e3fae7335ca4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:08.878874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ec63767a-4b92-439b-812e-e3fae7335ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:08.907325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:08.994968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b594cc-97c6-43ae-a8dc-87a75e6eccbf None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:09.007430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:09.023490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 86/162] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:09.024352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63767a-4b92-439b-812e-e3fae7335ca4 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:09.079494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:09.080038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:09.080320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:09.080594 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:09.081332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed, user.id=3586962b191746b79d7ae426435a3f36) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:09.081645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:09.084039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:09.090924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 77/163] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:08 2022] GET /identity/v3/role_assignments?user.id=3586962b191746b79d7ae426435a3f36&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:09.092665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:09.211319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63767a-4b92-439b-812e-e3fae7335ca4 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:09.263136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e8a2-035d-44e4-a2c7-1b5a3671c0e9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:09.278954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb1c09-b25c-4eba-b978-f29204d46e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:09.279588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb1c09-b25c-4eba-b978-f29204d46e7d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:09.279874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb1c09-b25c-4eba-b978-f29204d46e7d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:09.280279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb1c09-b25c-4eba-b978-f29204d46e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:09.324483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:09.331773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6bf67-03f1-45e6-95a6-af6423432e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:09.332921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6bf67-03f1-45e6-95a6-af6423432e68 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:09.333261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6bf67-03f1-45e6-95a6-af6423432e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:09.333586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6bf67-03f1-45e6-95a6-af6423432e68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:09.348984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6bf67-03f1-45e6-95a6-af6423432e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-b3c6bf67-03f1-45e6-95a6-af6423432e68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:09.355107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:09.355999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:09.356765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 78/164] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:09.362478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6bf67-03f1-45e6-95a6-af6423432e68 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:09.412212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:09.439658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb1c09-b25c-4eba-b978-f29204d46e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:09.440926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb1c09-b25c-4eba-b978-f29204d46e7d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:09.526747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6bf67-03f1-45e6-95a6-af6423432e68 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:09.584377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:09.585358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:09.585911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:09.586365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:09.587171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] RBAC: Adding query filter params (name=member) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:09.587741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:09.589672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:09.599406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 79/165] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:09.605546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:09.627168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 87/166] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:09.633559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb1c09-b25c-4eba-b978-f29204d46e7d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:09.766438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:09.767074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:09.774119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b80de-9cd1-41ce-8e12-edc022257948 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:09.815988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1d95-3e89-4a95-b212-23b244d058dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:09.816870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1d95-3e89-4a95-b212-23b244d058dc None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:09.817295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1d95-3e89-4a95-b212-23b244d058dc None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:09.817732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1d95-3e89-4a95-b212-23b244d058dc None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:09.819618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f1d95-3e89-4a95-b212-23b244d058dc None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:09.821306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f1d95-3e89-4a95-b212-23b244d058dc None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:09.823420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 80/167] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:09 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:09.831172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1d95-3e89-4a95-b212-23b244d058dc None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:09.871287 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb1c09-b25c-4eba-b978-f29204d46e7d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:09.938292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db401b5a-d792-42d2-81bc-b7518f3872cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:09.939207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401b5a-d792-42d2-81bc-b7518f3872cc None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:09.939636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401b5a-d792-42d2-81bc-b7518f3872cc None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:09.940066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401b5a-d792-42d2-81bc-b7518f3872cc None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:09.946860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db401b5a-d792-42d2-81bc-b7518f3872cc None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:09.948725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db401b5a-d792-42d2-81bc-b7518f3872cc None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:09.950646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 88/168] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:09 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:09.951463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1d95-3e89-4a95-b212-23b244d058dc None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:09.972932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db401b5a-d792-42d2-81bc-b7518f3872cc None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:09.993658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa8e6d-f7b1-4898-b0e9-c190706b65bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:09.994475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa8e6d-f7b1-4898-b0e9-c190706b65bd None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:09.994857 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa8e6d-f7b1-4898-b0e9-c190706b65bd None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:09.995228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa8e6d-f7b1-4898-b0e9-c190706b65bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.027309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:10.071919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa8e6d-f7b1-4898-b0e9-c190706b65bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:10.073561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa8e6d-f7b1-4898-b0e9-c190706b65bd None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:10.169401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db401b5a-d792-42d2-81bc-b7518f3872cc None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:10.182091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 81/169] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:15:10.183631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa8e6d-f7b1-4898-b0e9-c190706b65bd None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:10.198457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:10.239251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08adf3-0852-4445-815e-0d1b1913f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:10.239905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08adf3-0852-4445-815e-0d1b1913f265 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.240186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08adf3-0852-4445-815e-0d1b1913f265 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.240459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08adf3-0852-4445-815e-0d1b1913f265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.241283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08adf3-0852-4445-815e-0d1b1913f265 None admin] RBAC: Adding query filter params (role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed, user.id=d6c1c3430f93463687f21fe4d5ef6201) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:10.241606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08adf3-0852-4445-815e-0d1b1913f265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:10.243288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08adf3-0852-4445-815e-0d1b1913f265 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:10.251641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:10.260605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 89/170] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:09 2022] GET /identity/v3/role_assignments?user.id=d6c1c3430f93463687f21fe4d5ef6201&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:10.301396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18424828-fc52-40ca-982f-071f0d2e5888 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.301779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18424828-fc52-40ca-982f-071f0d2e5888 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.301946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18424828-fc52-40ca-982f-071f0d2e5888 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.303898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 90/171] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:10.305359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa8e6d-f7b1-4898-b0e9-c190706b65bd None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:10.309996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa370e4-a813-47c9-8717-228fa3d7dd01 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.314521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa370e4-a813-47c9-8717-228fa3d7dd01 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.314862 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa370e4-a813-47c9-8717-228fa3d7dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.347783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bfa370e4-a813-47c9-8717-228fa3d7dd01 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:10.349481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bfa370e4-a813-47c9-8717-228fa3d7dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:10.399601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70713ba-d69d-4dca-b707-63420ea460a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:10.400610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70713ba-d69d-4dca-b707-63420ea460a8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.401116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70713ba-d69d-4dca-b707-63420ea460a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.401666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70713ba-d69d-4dca-b707-63420ea460a8 None admin] PATH_INFO: `/v3/projects/4e01fb42751e4fdd954c871478d32e19` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.403143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70713ba-d69d-4dca-b707-63420ea460a8 None admin] RBAC: Authorizing `identity:get_project(project_id=4e01fb42751e4fdd954c871478d32e19)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:10.404806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70713ba-d69d-4dca-b707-63420ea460a8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:10.413507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 82/172] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:10 2022] GET /identity/v3/projects/4e01fb42751e4fdd954c871478d32e19 => generated 312 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:10.415308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beacd8-858c-47d8-9314-5f410e4b7bcd None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.415796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beacd8-858c-47d8-9314-5f410e4b7bcd None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.416354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beacd8-858c-47d8-9314-5f410e4b7bcd None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.418231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 83/173] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:10.419161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beacd8-858c-47d8-9314-5f410e4b7bcd None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:10.472175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 91/174] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:10.474493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1abc32-021e-485c-8629-210b3de58640 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.474971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1abc32-021e-485c-8629-210b3de58640 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.475582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1abc32-021e-485c-8629-210b3de58640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.496926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bb1abc32-021e-485c-8629-210b3de58640 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:10.498969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bb1abc32-021e-485c-8629-210b3de58640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:10.595180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 92/175] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:10.597038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1abc32-021e-485c-8629-210b3de58640 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:10.629892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beacd8-858c-47d8-9314-5f410e4b7bcd None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:10.658798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:10.695307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:10.711209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:10.712228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.712705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.713236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.714197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] RBAC: Adding query filter params (role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=4e01fb42751e4fdd954c871478d32e19, user.id=d6c1c3430f93463687f21fe4d5ef6201) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:10.714946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:10.718169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:10.730992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 84/176] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:10 2022] GET /identity/v3/role_assignments?user.id=d6c1c3430f93463687f21fe4d5ef6201&scope.project.id=4e01fb42751e4fdd954c871478d32e19&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:10.732170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:10.758973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1abc32-021e-485c-8629-210b3de58640 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:10.801310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fb3a-c685-478c-8574-e58db9beffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:10.802395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fb3a-c685-478c-8574-e58db9beffc6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.802935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fb3a-c685-478c-8574-e58db9beffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.803406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fb3a-c685-478c-8574-e58db9beffc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.821178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99fb3a-c685-478c-8574-e58db9beffc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-9e99fb3a-c685-478c-8574-e58db9beffc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:10.826517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:10.827388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:10.828189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:10.830496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 93/177] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:10.831929 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a700-f21f-444a-80e8-3786c525ef07 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.832423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a700-f21f-444a-80e8-3786c525ef07 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.832909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a700-f21f-444a-80e8-3786c525ef07 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.835590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 94/178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:10.836884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12a700-f21f-444a-80e8-3786c525ef07 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:10.874820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8274a83-31a7-497e-a464-1aa6b94aa286 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:10.924482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32845fa1-f9c6-4c7e-9176-8fa156e0a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:10.925127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845fa1-f9c6-4c7e-9176-8fa156e0a636 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.925404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845fa1-f9c6-4c7e-9176-8fa156e0a636 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.925674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845fa1-f9c6-4c7e-9176-8fa156e0a636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.942315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32845fa1-f9c6-4c7e-9176-8fa156e0a636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-32845fa1-f9c6-4c7e-9176-8fa156e0a636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:10.954710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:10.955900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:10.956716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:10.958540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 85/179] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:10.959454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca6d1-e431-44d5-af29-6a59ddb6b6e3 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:10.959737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca6d1-e431-44d5-af29-6a59ddb6b6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:10.960008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca6d1-e431-44d5-af29-6a59ddb6b6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:10.992927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:10.996751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3a0ca6d1-e431-44d5-af29-6a59ddb6b6e3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:10.997987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3a0ca6d1-e431-44d5-af29-6a59ddb6b6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:11.001769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12a700-f21f-444a-80e8-3786c525ef07 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:11.039066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:11.039682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.039962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.040238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.040903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:11.041207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:11.042846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:11.056909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 95/180] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:11.056909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.076220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:11.100494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 86/181] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:11.101745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ca6d1-e431-44d5-af29-6a59ddb6b6e3 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.170838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074777d4-5801-432e-8785-d9042cd2c23d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:11.209411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:11.210030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.210342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.210615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.211466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:11.211773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:11.213154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:11.228167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 96/182] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:11.229084 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.229943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ca6d1-e431-44d5-af29-6a59ddb6b6e3 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:11.258788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:11.283965 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f32556-67da-4310-b14d-be5e5cc5ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:11.285000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f32556-67da-4310-b14d-be5e5cc5ef3e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.285480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f32556-67da-4310-b14d-be5e5cc5ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.285922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f32556-67da-4310-b14d-be5e5cc5ef3e None admin] PATH_INFO: `/v3/users/d6c1c3430f93463687f21fe4d5ef6201` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.289335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f32556-67da-4310-b14d-be5e5cc5ef3e None admin] RBAC: Authorizing `identity:get_user(user_id=d6c1c3430f93463687f21fe4d5ef6201)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:11.291721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f32556-67da-4310-b14d-be5e5cc5ef3e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:11.293927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 87/183] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/users/d6c1c3430f93463687f21fe4d5ef6201 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:11.294975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f32556-67da-4310-b14d-be5e5cc5ef3e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.348436 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed3980-5d48-4df9-80fa-59adc0bc342d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:11.356720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:11.383068 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc78f-d29a-4621-8528-4fc9f5d46ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:11.383696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc78f-d29a-4621-8528-4fc9f5d46ea8 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.383974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc78f-d29a-4621-8528-4fc9f5d46ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.384243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc78f-d29a-4621-8528-4fc9f5d46ea8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.394271 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cc78f-d29a-4621-8528-4fc9f5d46ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-c19cc78f-d29a-4621-8528-4fc9f5d46ea8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:11.400798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:11.401718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:11.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 97/184] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:11.403185 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc78f-d29a-4621-8528-4fc9f5d46ea8 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.408452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f32556-67da-4310-b14d-be5e5cc5ef3e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:11.441969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594b17f-eb13-4839-b5fe-688bd3fc2356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:11.442627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594b17f-eb13-4839-b5fe-688bd3fc2356 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.442933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594b17f-eb13-4839-b5fe-688bd3fc2356 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.443204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594b17f-eb13-4839-b5fe-688bd3fc2356 None admin] PATH_INFO: `/v3/users/f81414ec2db54135a1ea3b31e5ee6d29` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.455910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594b17f-eb13-4839-b5fe-688bd3fc2356 None admin] RBAC: Authorizing `identity:get_user(user_id=f81414ec2db54135a1ea3b31e5ee6d29)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:11.457350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594b17f-eb13-4839-b5fe-688bd3fc2356 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:11.459534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 88/185] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/users/f81414ec2db54135a1ea3b31e5ee6d29 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:11.459534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1bb00-5ed1-4cd7-92dc-a57cbdc68ee2 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.459534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1bb00-5ed1-4cd7-92dc-a57cbdc68ee2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.459534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1bb00-5ed1-4cd7-92dc-a57cbdc68ee2 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.459534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 89/186] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:11.459534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474f6ff-d03d-446a-8496-c65fa3f0ef19 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.464752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474f6ff-d03d-446a-8496-c65fa3f0ef19 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.464752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474f6ff-d03d-446a-8496-c65fa3f0ef19 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.465026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 90/187] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:11.465781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474f6ff-d03d-446a-8496-c65fa3f0ef19 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.494923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:11.510738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc78f-d29a-4621-8528-4fc9f5d46ea8 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:11.543958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df524d8-4992-4be9-b5ae-dfc832ef614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:11.544555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df524d8-4992-4be9-b5ae-dfc832ef614f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.544835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df524d8-4992-4be9-b5ae-dfc832ef614f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.545114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df524d8-4992-4be9-b5ae-dfc832ef614f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.566951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474f6ff-d03d-446a-8496-c65fa3f0ef19 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:11.575854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:11.600504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:11.601095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.601373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.601644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.602328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:11.602630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:11.604009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:11.610655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df524d8-4992-4be9-b5ae-dfc832ef614f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:11.611606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 91/188] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:11.612104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df524d8-4992-4be9-b5ae-dfc832ef614f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:11.612381 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.693083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:11.710232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 98/189] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:11.711814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb91f5-b1fd-4056-925b-7cbd6db29150 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.712104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb91f5-b1fd-4056-925b-7cbd6db29150 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.712378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb91f5-b1fd-4056-925b-7cbd6db29150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.713117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce47ae-fe08-4bd4-9f97-9ef834904aed None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:11.730334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e1bb91f5-b1fd-4056-925b-7cbd6db29150 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:11.731509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e1bb91f5-b1fd-4056-925b-7cbd6db29150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:11.745832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624464f1-cf10-49ac-a4d1-fef7d94e9c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:11.746466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624464f1-cf10-49ac-a4d1-fef7d94e9c56 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.746741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624464f1-cf10-49ac-a4d1-fef7d94e9c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.747008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624464f1-cf10-49ac-a4d1-fef7d94e9c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.784656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:11.795908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 99/190] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:11.797291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670fe64-058b-42a7-912f-cec68d6e183d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:11.797574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670fe64-058b-42a7-912f-cec68d6e183d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:11.797843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670fe64-058b-42a7-912f-cec68d6e183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:11.813534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624464f1-cf10-49ac-a4d1-fef7d94e9c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:11.815014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624464f1-cf10-49ac-a4d1-fef7d94e9c56 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:11.824945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8670fe64-058b-42a7-912f-cec68d6e183d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:11.826176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8670fe64-058b-42a7-912f-cec68d6e183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:11.893310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 100/191] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:11.894176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670fe64-058b-42a7-912f-cec68d6e183d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.910563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 92/192] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:11.911275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624464f1-cf10-49ac-a4d1-fef7d94e9c56 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:11.953671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:11.978292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:12.005658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670fe64-058b-42a7-912f-cec68d6e183d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.008007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624464f1-cf10-49ac-a4d1-fef7d94e9c56 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.039151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa87347-982f-44bd-8dc4-1e5a8f3191e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.039718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa87347-982f-44bd-8dc4-1e5a8f3191e3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.039995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa87347-982f-44bd-8dc4-1e5a8f3191e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.040266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa87347-982f-44bd-8dc4-1e5a8f3191e3 None admin] PATH_INFO: `/v3/users/f81414ec2db54135a1ea3b31e5ee6d29` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.041208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fef95-1c62-4e59-a6b6-533a74f06764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.041370 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa87347-982f-44bd-8dc4-1e5a8f3191e3 None admin] RBAC: Authorizing `identity:get_user(user_id=f81414ec2db54135a1ea3b31e5ee6d29)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.041822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fef95-1c62-4e59-a6b6-533a74f06764 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.042132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fef95-1c62-4e59-a6b6-533a74f06764 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.042406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fef95-1c62-4e59-a6b6-533a74f06764 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.042850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa87347-982f-44bd-8dc4-1e5a8f3191e3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.043546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fef95-1c62-4e59-a6b6-533a74f06764 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.044420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 101/193] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/users/f81414ec2db54135a1ea3b31e5ee6d29 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:12.048968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fef95-1c62-4e59-a6b6-533a74f06764 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.049060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa87347-982f-44bd-8dc4-1e5a8f3191e3 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.049142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 93/194] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:11 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:12.049142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fef95-1c62-4e59-a6b6-533a74f06764 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.147097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa87347-982f-44bd-8dc4-1e5a8f3191e3 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.150008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fef95-1c62-4e59-a6b6-533a74f06764 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.160147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:12.181741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc528-da3d-4a67-ae99-26945b010b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.182387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc528-da3d-4a67-ae99-26945b010b9f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.182523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f8a6-636c-4e86-98ad-cf42ad90618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.182647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc528-da3d-4a67-ae99-26945b010b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.182919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc528-da3d-4a67-ae99-26945b010b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.183187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f8a6-636c-4e86-98ad-cf42ad90618e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.183473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f8a6-636c-4e86-98ad-cf42ad90618e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.183744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f8a6-636c-4e86-98ad-cf42ad90618e None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.183998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc528-da3d-4a67-ae99-26945b010b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.184852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f8a6-636c-4e86-98ad-cf42ad90618e None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.185429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc528-da3d-4a67-ae99-26945b010b9f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.186306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f8a6-636c-4e86-98ad-cf42ad90618e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.187004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 102/195] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:12.187764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc528-da3d-4a67-ae99-26945b010b9f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.192401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 94/196] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:12.193285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f8a6-636c-4e86-98ad-cf42ad90618e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.202166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:12.286077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc528-da3d-4a67-ae99-26945b010b9f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.293819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f8a6-636c-4e86-98ad-cf42ad90618e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.319679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067ff8-0d39-472b-af6c-84b21db8e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.320294 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067ff8-0d39-472b-af6c-84b21db8e256 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.320572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067ff8-0d39-472b-af6c-84b21db8e256 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.320843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067ff8-0d39-472b-af6c-84b21db8e256 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.327713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c92d4-460a-430d-8230-53a5344905cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.328311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c92d4-460a-430d-8230-53a5344905cf None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.328586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c92d4-460a-430d-8230-53a5344905cf None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.328856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c92d4-460a-430d-8230-53a5344905cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.330722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf067ff8-0d39-472b-af6c-84b21db8e256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-bf067ff8-0d39-472b-af6c-84b21db8e256 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:12.335413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:12.336262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:12.337024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 103/197] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:12.337664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067ff8-0d39-472b-af6c-84b21db8e256 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.383755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:12.399899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c92d4-460a-430d-8230-53a5344905cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.401446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c92d4-460a-430d-8230-53a5344905cf None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.409137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:12.440711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067ff8-0d39-472b-af6c-84b21db8e256 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.472799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.473393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.473676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.474490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.475203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] RBAC: Adding query filter params (role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed, user.id=d6c1c3430f93463687f21fe4d5ef6201) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:12.475508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.476918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.482652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 104/198] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/role_assignments?user.id=d6c1c3430f93463687f21fe4d5ef6201&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=45f0e969ef594665877c4596781ce6aa => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:12.483229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.500268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 95/199] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:12.501031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c92d4-460a-430d-8230-53a5344905cf None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.611658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e69001-4683-459e-bb84-960ec251f77c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.613127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c92d4-460a-430d-8230-53a5344905cf None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.615356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:12.621650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:12.657848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.658487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.658764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.659031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.659572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec5566-ce47-40a4-93ac-52474d714053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.659796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512, user.id=f81414ec2db54135a1ea3b31e5ee6d29) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:12.660052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.660220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5566-ce47-40a4-93ac-52474d714053 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.660451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5566-ce47-40a4-93ac-52474d714053 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.660722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5566-ce47-40a4-93ac-52474d714053 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.661400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec5566-ce47-40a4-93ac-52474d714053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.661514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.662894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec5566-ce47-40a4-93ac-52474d714053 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.667357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 96/200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/role_assignments?user.id=f81414ec2db54135a1ea3b31e5ee6d29&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:12.668004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.688756 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 105/201] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:12 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:12.689621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec5566-ce47-40a4-93ac-52474d714053 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.830608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c397-7034-4a2b-b14a-086c40bffdb1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.841195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec5566-ce47-40a4-93ac-52474d714053 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:12.883373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.884616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.884616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.884616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.885025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:12.885329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.886766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.893547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993fe2c-5b09-4ede-979c-2e9b6a0a7874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:12.894453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993fe2c-5b09-4ede-979c-2e9b6a0a7874 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:12.895174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993fe2c-5b09-4ede-979c-2e9b6a0a7874 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:12.895454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993fe2c-5b09-4ede-979c-2e9b6a0a7874 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:12.896883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 97/202] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:12.898197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993fe2c-5b09-4ede-979c-2e9b6a0a7874 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:12.899739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993fe2c-5b09-4ede-979c-2e9b6a0a7874 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:12.901940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 106/203] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:12.903035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.907908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993fe2c-5b09-4ede-979c-2e9b6a0a7874 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:12.941386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:12.948304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:13.034870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8740e-9981-4b79-8e91-616bc9e58209 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:13.044026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993fe2c-5b09-4ede-979c-2e9b6a0a7874 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:13.081938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b833e9-6b01-492f-a763-ed3429ab7223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:13.082986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b833e9-6b01-492f-a763-ed3429ab7223 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:13.084021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b833e9-6b01-492f-a763-ed3429ab7223 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:13.084512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b833e9-6b01-492f-a763-ed3429ab7223 None admin] PATH_INFO: `/v3/users/fc8547e646f8419b98784436701cfada` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:13.084914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:13.085609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:13.085890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:13.086184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:13.086740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b833e9-6b01-492f-a763-ed3429ab7223 None admin] RBAC: Authorizing `identity:get_user(user_id=fc8547e646f8419b98784436701cfada)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:13.086909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] RBAC: Adding query filter params (role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512, user.id=f81414ec2db54135a1ea3b31e5ee6d29) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:13.087207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:13.088645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:13.089066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b833e9-6b01-492f-a763-ed3429ab7223 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:13.091462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 98/204] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/users/fc8547e646f8419b98784436701cfada => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:13.095636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 107/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:12 2022] GET /identity/v3/role_assignments?user.id=f81414ec2db54135a1ea3b31e5ee6d29&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=45f0e969ef594665877c4596781ce6aa => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:13.097602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b833e9-6b01-492f-a763-ed3429ab7223 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:13.216598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:13.220708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b833e9-6b01-492f-a763-ed3429ab7223 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:13.268584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0308eef-2163-4f5c-a256-646d89aa61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:13.269197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0308eef-2163-4f5c-a256-646d89aa61fe None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:13.269475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0308eef-2163-4f5c-a256-646d89aa61fe None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:13.269746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0308eef-2163-4f5c-a256-646d89aa61fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:13.341171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0308eef-2163-4f5c-a256-646d89aa61fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:13.342675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0308eef-2163-4f5c-a256-646d89aa61fe None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:13.471432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:13.476176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 99/206] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:15:13.481740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:13.609831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:13.621053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26903324-3a5c-4ec3-b7eb-35f3782e91a4 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:13.674927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8965f5-d31b-428d-a5be-046cbed7a0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:13.675563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8965f5-d31b-428d-a5be-046cbed7a0da None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:13.675849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8965f5-d31b-428d-a5be-046cbed7a0da None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:13.676124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8965f5-d31b-428d-a5be-046cbed7a0da None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:13.677787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8965f5-d31b-428d-a5be-046cbed7a0da None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:13.679256 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8965f5-d31b-428d-a5be-046cbed7a0da None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:13.681201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 108/207] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:13 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:13.686875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0308eef-2163-4f5c-a256-646d89aa61fe None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:13.819976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0308eef-2163-4f5c-a256-646d89aa61fe None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:13.863731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4adddc-7978-4539-adda-9a697d50d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:13.864874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4adddc-7978-4539-adda-9a697d50d37a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:13.865193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4adddc-7978-4539-adda-9a697d50d37a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:13.865464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4adddc-7978-4539-adda-9a697d50d37a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:13.866227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4adddc-7978-4539-adda-9a697d50d37a None admin] RBAC: Adding query filter params (role.id=8a7ad38a846e4411ac1dcc42523f6085, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed, user.id=fc8547e646f8419b98784436701cfada) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:13.866539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4adddc-7978-4539-adda-9a697d50d37a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:13.868000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4adddc-7978-4539-adda-9a697d50d37a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:13.879290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 100/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:13 2022] GET /identity/v3/role_assignments?user.id=fc8547e646f8419b98784436701cfada&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=8a7ad38a846e4411ac1dcc42523f6085 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:14.979123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf9908-7329-442c-9a54-a26e81daab1a None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:14.980132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf9908-7329-442c-9a54-a26e81daab1a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:14.980626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf9908-7329-442c-9a54-a26e81daab1a None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:14.982248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 109/209] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:14.987889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a811a0-aaf5-4799-8340-f40bc774d277 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:14.988719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a811a0-aaf5-4799-8340-f40bc774d277 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:14.989190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a811a0-aaf5-4799-8340-f40bc774d277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.009115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f8a811a0-aaf5-4799-8340-f40bc774d277 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:15.010398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f8a811a0-aaf5-4799-8340-f40bc774d277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:15.070674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:15.086207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 101/210] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:15.100516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf9908-7329-442c-9a54-a26e81daab1a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.207866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf9908-7329-442c-9a54-a26e81daab1a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:15.227311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad9298-bef7-4d92-afa0-47fd3f83632d None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.227614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad9298-bef7-4d92-afa0-47fd3f83632d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.227865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad9298-bef7-4d92-afa0-47fd3f83632d None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.229209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 102/211] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:15.237477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaddd2-1650-4b44-abff-efbf1140802f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.237953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaddd2-1650-4b44-abff-efbf1140802f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.238319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaddd2-1650-4b44-abff-efbf1140802f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.248251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b435e7c-3ba6-4c61-a428-d59dc6ea5696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:15.248886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435e7c-3ba6-4c61-a428-d59dc6ea5696 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.249167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435e7c-3ba6-4c61-a428-d59dc6ea5696 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.249441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435e7c-3ba6-4c61-a428-d59dc6ea5696 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.260394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b435e7c-3ba6-4c61-a428-d59dc6ea5696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:15.261423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-6baaddd2-1650-4b44-abff-efbf1140802f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:15.262705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6baaddd2-1650-4b44-abff-efbf1140802f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-9b435e7c-3ba6-4c61-a428-d59dc6ea5696 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:15.265528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:15.266422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:15.267195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 110/212] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:15.278111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b435e7c-3ba6-4c61-a428-d59dc6ea5696 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.301320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:15.351532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 103/213] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:15.352609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeff57f-e4c7-4398-b83d-ab086b7f89f3 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.352895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeff57f-e4c7-4398-b83d-ab086b7f89f3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.353165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeff57f-e4c7-4398-b83d-ab086b7f89f3 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.358252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 104/214] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:15.359586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c840-b3c5-4c04-beaf-c3ad58c89b85 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.359865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c840-b3c5-4c04-beaf-c3ad58c89b85 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.360136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c840-b3c5-4c04-beaf-c3ad58c89b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.378358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-2339c840-b3c5-4c04-beaf-c3ad58c89b85 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:15.379562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-2339c840-b3c5-4c04-beaf-c3ad58c89b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:15.397979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b435e7c-3ba6-4c61-a428-d59dc6ea5696 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:15.432259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:15.432862 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.433140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.433412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.434087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:15.434398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:15.435759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:15.443586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 111/215] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:15.444357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.449766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 105/216] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:15.463589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499298e-62c2-42f6-a76e-22c2a830fb2d None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.463865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499298e-62c2-42f6-a76e-22c2a830fb2d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.464528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499298e-62c2-42f6-a76e-22c2a830fb2d None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.465878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 106/217] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:15 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:15.466624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499298e-62c2-42f6-a76e-22c2a830fb2d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.522610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:15.528879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:15.547672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238dac-7c55-4ba3-a6e9-91fb8b0149ea None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:15.569766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499298e-62c2-42f6-a76e-22c2a830fb2d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:15.582055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b1032-4b30-4983-8d05-1ef7aad85fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:15.582705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b1032-4b30-4983-8d05-1ef7aad85fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.582981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b1032-4b30-4983-8d05-1ef7aad85fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.583853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b1032-4b30-4983-8d05-1ef7aad85fd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.584937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b1032-4b30-4983-8d05-1ef7aad85fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:15.586402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b1032-4b30-4983-8d05-1ef7aad85fd0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:15.587957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 112/218] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:15.589039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a94b-c1ed-437f-a806-c9bf237c38e8 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.589315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a94b-c1ed-437f-a806-c9bf237c38e8 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.589586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a94b-c1ed-437f-a806-c9bf237c38e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.606224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9c8ea-0171-496b-af8e-143159226b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:15.606387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8d11a94b-c1ed-437f-a806-c9bf237c38e8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:15.606866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c8ea-0171-496b-af8e-143159226b28 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.607146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c8ea-0171-496b-af8e-143159226b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.607419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c8ea-0171-496b-af8e-143159226b28 None admin] PATH_INFO: `/v3/users/f81414ec2db54135a1ea3b31e5ee6d29` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.607582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8d11a94b-c1ed-437f-a806-c9bf237c38e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:15.608551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9c8ea-0171-496b-af8e-143159226b28 None admin] RBAC: Authorizing `identity:get_user(user_id=f81414ec2db54135a1ea3b31e5ee6d29)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:15.610001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9c8ea-0171-496b-af8e-143159226b28 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:15.611604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 107/219] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:15 2022] GET /identity/v3/users/f81414ec2db54135a1ea3b31e5ee6d29 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:15.612358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9c8ea-0171-496b-af8e-143159226b28 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.675423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 113/220] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:15.676534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11a94b-c1ed-437f-a806-c9bf237c38e8 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.717660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9c8ea-0171-496b-af8e-143159226b28 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:15.740003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:15.751961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c41ca5-57ec-4b85-a07e-25be02838e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:15.752585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c41ca5-57ec-4b85-a07e-25be02838e93 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.752860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c41ca5-57ec-4b85-a07e-25be02838e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.753136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c41ca5-57ec-4b85-a07e-25be02838e93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.763627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c41ca5-57ec-4b85-a07e-25be02838e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-74c41ca5-57ec-4b85-a07e-25be02838e93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:15.768690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:15.769560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:15.770901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 108/221] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:15.772116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c41ca5-57ec-4b85-a07e-25be02838e93 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.772325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:15.791620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11a94b-c1ed-437f-a806-c9bf237c38e8 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:15.826289 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fa982-37d9-41cc-9e59-b39857fd2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:15.826990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fa982-37d9-41cc-9e59-b39857fd2b1c None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.827269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fa982-37d9-41cc-9e59-b39857fd2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.827536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fa982-37d9-41cc-9e59-b39857fd2b1c None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.828167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fa982-37d9-41cc-9e59-b39857fd2b1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:15.829607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fa982-37d9-41cc-9e59-b39857fd2b1c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:15.852265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 114/222] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:15 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:15.854261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fa982-37d9-41cc-9e59-b39857fd2b1c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.884780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c41ca5-57ec-4b85-a07e-25be02838e93 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:15.927559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659be63-78bc-48c1-a1b5-c95888128332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:15.928213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659be63-78bc-48c1-a1b5-c95888128332 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:15.928492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659be63-78bc-48c1-a1b5-c95888128332 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:15.928763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659be63-78bc-48c1-a1b5-c95888128332 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:15.930775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659be63-78bc-48c1-a1b5-c95888128332 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:15.932268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659be63-78bc-48c1-a1b5-c95888128332 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:15.939610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 109/223] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:15 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:15.939610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659be63-78bc-48c1-a1b5-c95888128332 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:15.983852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fa982-37d9-41cc-9e59-b39857fd2b1c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:15.997171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:16.022368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bd2b7-8066-4b98-b2d7-ccf7a77c747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.023484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd2b7-8066-4b98-b2d7-ccf7a77c747e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.023592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd2b7-8066-4b98-b2d7-ccf7a77c747e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.024600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd2b7-8066-4b98-b2d7-ccf7a77c747e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.027501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:16.038980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bd2b7-8066-4b98-b2d7-ccf7a77c747e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-5f0bd2b7-8066-4b98-b2d7-ccf7a77c747e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:16.043682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:16.044552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:16.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 115/224] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:16.045982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bd2b7-8066-4b98-b2d7-ccf7a77c747e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:16.060788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659be63-78bc-48c1-a1b5-c95888128332 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:16.104171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.105137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.106047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.106571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.107398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] RBAC: Adding query filter params (name=member) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:16.107891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:16.109492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:16.118807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 110/225] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:16.119906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:16.178686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bd2b7-8066-4b98-b2d7-ccf7a77c747e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:16.220514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054a2b-72ba-447a-9c7c-1f66ab60b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.221189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054a2b-72ba-447a-9c7c-1f66ab60b490 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.221474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054a2b-72ba-447a-9c7c-1f66ab60b490 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.221750 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054a2b-72ba-447a-9c7c-1f66ab60b490 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/users/f81414ec2db54135a1ea3b31e5ee6d29/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.224336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054a2b-72ba-447a-9c7c-1f66ab60b490 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4f3487ce94cc4b6371ef214d4c512, user_id=f81414ec2db54135a1ea3b31e5ee6d29, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:16.227083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054a2b-72ba-447a-9c7c-1f66ab60b490 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:16.248827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492046a-879b-4609-87b1-c74d392edb22 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:16.250364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 116/226] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:16 2022] PUT /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/users/f81414ec2db54135a1ea3b31e5ee6d29/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:16.251534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054a2b-72ba-447a-9c7c-1f66ab60b490 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:16.263181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:16.294451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.295936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.296334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.296680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.297676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:16.298196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:16.302391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:16.313212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 111/227] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:16.319161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:16.373807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:16.470877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054a2b-72ba-447a-9c7c-1f66ab60b490 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:16.515623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ecad-1e26-44f4-a2c6-a52235944f98 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:16.519531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766ee00-a973-4ec0-87bb-38f9b71d4260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.520461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766ee00-a973-4ec0-87bb-38f9b71d4260 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.520748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766ee00-a973-4ec0-87bb-38f9b71d4260 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.521021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766ee00-a973-4ec0-87bb-38f9b71d4260 None admin] PATH_INFO: `/v3/users/23f6be29dbdd49e79d79c2d0d20f9d98` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.538948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766ee00-a973-4ec0-87bb-38f9b71d4260 None admin] RBAC: Authorizing `identity:get_user(user_id=23f6be29dbdd49e79d79c2d0d20f9d98)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:16.540614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766ee00-a973-4ec0-87bb-38f9b71d4260 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:16.546171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 117/228] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:16 2022] GET /identity/v3/users/23f6be29dbdd49e79d79c2d0d20f9d98 => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:16.548691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766ee00-a973-4ec0-87bb-38f9b71d4260 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:16.570762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a52c4-8f25-4219-8dff-b5940b07e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.571399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a52c4-8f25-4219-8dff-b5940b07e10c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.571675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a52c4-8f25-4219-8dff-b5940b07e10c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.571944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a52c4-8f25-4219-8dff-b5940b07e10c None admin] PATH_INFO: `/v3/users/f81414ec2db54135a1ea3b31e5ee6d29` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.573082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a52c4-8f25-4219-8dff-b5940b07e10c None admin] RBAC: Authorizing `identity:get_user(user_id=f81414ec2db54135a1ea3b31e5ee6d29)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:16.574567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a52c4-8f25-4219-8dff-b5940b07e10c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:16.576263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 112/229] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:16 2022] GET /identity/v3/users/f81414ec2db54135a1ea3b31e5ee6d29 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:16.581570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a52c4-8f25-4219-8dff-b5940b07e10c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:16.630838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:16.682531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766ee00-a973-4ec0-87bb-38f9b71d4260 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:16.690011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a52c4-8f25-4219-8dff-b5940b07e10c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:16.699821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:16.721390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d57f9b-920a-42d2-909a-146797ef32b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.722172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57f9b-920a-42d2-909a-146797ef32b2 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.722550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57f9b-920a-42d2-909a-146797ef32b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.722919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57f9b-920a-42d2-909a-146797ef32b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.756263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67f065-3759-4211-b9bb-53393dc3e0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.757088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67f065-3759-4211-b9bb-53393dc3e0cb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.757464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67f065-3759-4211-b9bb-53393dc3e0cb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.757851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67f065-3759-4211-b9bb-53393dc3e0cb None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.759172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67f065-3759-4211-b9bb-53393dc3e0cb None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:16.760780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67f065-3759-4211-b9bb-53393dc3e0cb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:16.762891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 113/230] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:16 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:16.768525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67f065-3759-4211-b9bb-53393dc3e0cb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:16.846883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d57f9b-920a-42d2-909a-146797ef32b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:16.848374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d57f9b-920a-42d2-909a-146797ef32b2 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:16.947675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67f065-3759-4211-b9bb-53393dc3e0cb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:16.984041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2ab82-4d14-478b-89a4-7bff7c0c544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:16.985063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ab82-4d14-478b-89a4-7bff7c0c544a None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:16.985545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ab82-4d14-478b-89a4-7bff7c0c544a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:16.986033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ab82-4d14-478b-89a4-7bff7c0c544a None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/users/f81414ec2db54135a1ea3b31e5ee6d29/roles/45f0e969ef594665877c4596781ce6aa` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:16.988443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2ab82-4d14-478b-89a4-7bff7c0c544a None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4f3487ce94cc4b6371ef214d4c512, user_id=f81414ec2db54135a1ea3b31e5ee6d29, role_id=45f0e969ef594665877c4596781ce6aa)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:16.990773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:16.991479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2ab82-4d14-478b-89a4-7bff7c0c544a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:17.013526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 114/231] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:16 2022] PUT /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/users/f81414ec2db54135a1ea3b31e5ee6d29/roles/45f0e969ef594665877c4596781ce6aa => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:15:17.070329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 118/232] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:15:17.076398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2ab82-4d14-478b-89a4-7bff7c0c544a None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:17.222057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2ab82-4d14-478b-89a4-7bff7c0c544a None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:17.259818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cbbde-8c8f-4858-b450-9916b3d2ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:17.260812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbbde-8c8f-4858-b450-9916b3d2ae84 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:17.261312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbbde-8c8f-4858-b450-9916b3d2ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:17.261775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbbde-8c8f-4858-b450-9916b3d2ae84 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:17.263110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cbbde-8c8f-4858-b450-9916b3d2ae84 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:17.264753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cbbde-8c8f-4858-b450-9916b3d2ae84 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:17.267053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 115/233] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:17 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:17.275265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d57f9b-920a-42d2-909a-146797ef32b2 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:17.308025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:17.416499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d57f9b-920a-42d2-909a-146797ef32b2 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:17.452350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996ad85-9844-43e4-add2-e7308109d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:17.452949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996ad85-9844-43e4-add2-e7308109d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:17.453231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996ad85-9844-43e4-add2-e7308109d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:17.453505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996ad85-9844-43e4-add2-e7308109d9e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:17.454264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996ad85-9844-43e4-add2-e7308109d9e8 None admin] RBAC: Adding query filter params (role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512, user.id=23f6be29dbdd49e79d79c2d0d20f9d98) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:17.454577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996ad85-9844-43e4-add2-e7308109d9e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:17.455999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996ad85-9844-43e4-add2-e7308109d9e8 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:17.461988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 119/234] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:17 2022] GET /identity/v3/role_assignments?user.id=23f6be29dbdd49e79d79c2d0d20f9d98&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:18.269240 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cdf51-ddf8-40dc-b3bb-44f731357a47 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.270000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cdf51-ddf8-40dc-b3bb-44f731357a47 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.270099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cdf51-ddf8-40dc-b3bb-44f731357a47 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.271942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 116/235] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:18.277042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160794-cca4-4499-9d07-1d39648c5745 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.277432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160794-cca4-4499-9d07-1d39648c5745 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.277594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160794-cca4-4499-9d07-1d39648c5745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.283466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8d859-3c66-4a21-8cd6-14b3c141babb None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.283748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8d859-3c66-4a21-8cd6-14b3c141babb None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.284026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8d859-3c66-4a21-8cd6-14b3c141babb None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.285296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 117/236] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:18.292193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f469b2-94a9-46e3-a8c8-3ac59e10dab1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.292472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f469b2-94a9-46e3-a8c8-3ac59e10dab1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.292745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f469b2-94a9-46e3-a8c8-3ac59e10dab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.313160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-fd160794-cca4-4499-9d07-1d39648c5745 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:18.314461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fd160794-cca4-4499-9d07-1d39648c5745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:18.327016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-98f469b2-94a9-46e3-a8c8-3ac59e10dab1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:18.328212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-98f469b2-94a9-46e3-a8c8-3ac59e10dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:18.376947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:18.437009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 120/237] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:18.452275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 118/238] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:18.466752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd160794-cca4-4499-9d07-1d39648c5745 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:18.483283 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f469b2-94a9-46e3-a8c8-3ac59e10dab1 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:18.486192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:18.587650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f469b2-94a9-46e3-a8c8-3ac59e10dab1 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:18.639897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6d27-9228-4be6-8925-9a2577ca3bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:18.640527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6d27-9228-4be6-8925-9a2577ca3bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.640804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6d27-9228-4be6-8925-9a2577ca3bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.641074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6d27-9228-4be6-8925-9a2577ca3bb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.652954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b6d27-9228-4be6-8925-9a2577ca3bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-d76b6d27-9228-4be6-8925-9a2577ca3bb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:18.658800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:18.659647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:18.660437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 119/239] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:18.669818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6d27-9228-4be6-8925-9a2577ca3bb6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:18.684928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd160794-cca4-4499-9d07-1d39648c5745 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:18.711506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:18.748440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa21e90-b958-46b7-8c24-c1bde974ca93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:18.749088 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21e90-b958-46b7-8c24-c1bde974ca93 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.749365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21e90-b958-46b7-8c24-c1bde974ca93 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.749635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21e90-b958-46b7-8c24-c1bde974ca93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.751003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa21e90-b958-46b7-8c24-c1bde974ca93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:18.752463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa21e90-b958-46b7-8c24-c1bde974ca93 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:18.754446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 121/240] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:18.763442 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa21e90-b958-46b7-8c24-c1bde974ca93 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:18.849126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:18.881574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa21e90-b958-46b7-8c24-c1bde974ca93 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:18.919199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6d27-9228-4be6-8925-9a2577ca3bb6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:18.930045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ff605-495f-45b2-a48e-9e701d53a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:18.930728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff605-495f-45b2-a48e-9e701d53a1cc None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.931013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff605-495f-45b2-a48e-9e701d53a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.931287 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff605-495f-45b2-a48e-9e701d53a1cc None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.931931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ff605-495f-45b2-a48e-9e701d53a1cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:18.933380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ff605-495f-45b2-a48e-9e701d53a1cc None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:18.971627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 122/241] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:18 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:18.973001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48b9e4-d5f0-4116-abfc-725cea7b9624 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.973292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48b9e4-d5f0-4116-abfc-725cea7b9624 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.973607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48b9e4-d5f0-4116-abfc-725cea7b9624 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.978809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:18.978979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 123/242] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:18.979560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.979844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.980171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.980343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d62eb-4298-43d3-ac0f-75c562d5cd25 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:18.980603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d62eb-4298-43d3-ac0f-75c562d5cd25 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:18.980851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:18.980962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d62eb-4298-43d3-ac0f-75c562d5cd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:18.981160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:18.982657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:18.999001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 120/243] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:19.001859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-755d62eb-4298-43d3-ac0f-75c562d5cd25 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:19.003148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-755d62eb-4298-43d3-ac0f-75c562d5cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:19.006912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:19.108327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 124/244] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:19.169552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:19.174210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d62eb-4298-43d3-ac0f-75c562d5cd25 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:19.183927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027feda-f039-4756-8028-dc23a849d3bb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:19.231435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca8b52-c4ce-466b-a417-5e3deabb1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:19.232085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8b52-c4ce-466b-a417-5e3deabb1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.232369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8b52-c4ce-466b-a417-5e3deabb1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.232648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8b52-c4ce-466b-a417-5e3deabb1ff2 None admin] PATH_INFO: `/v3/users/8ed73a6381b04d71b3ac1e13c03a156d` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.249313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca8b52-c4ce-466b-a417-5e3deabb1ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=8ed73a6381b04d71b3ac1e13c03a156d)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:19.250792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:19.251914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca8b52-c4ce-466b-a417-5e3deabb1ff2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:19.254121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 121/245] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:19 2022] GET /identity/v3/users/8ed73a6381b04d71b3ac1e13c03a156d => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:19.260947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca8b52-c4ce-466b-a417-5e3deabb1ff2 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:19.305649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d62eb-4298-43d3-ac0f-75c562d5cd25 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:19.353228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de52e3-73a7-465c-98cf-a5e7305ce979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:19.353872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de52e3-73a7-465c-98cf-a5e7305ce979 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.354182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de52e3-73a7-465c-98cf-a5e7305ce979 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.354460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de52e3-73a7-465c-98cf-a5e7305ce979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.368321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de52e3-73a7-465c-98cf-a5e7305ce979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-c0de52e3-73a7-465c-98cf-a5e7305ce979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:19.375894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:19.377574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:19.379264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 125/246] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:19.384955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de52e3-73a7-465c-98cf-a5e7305ce979 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:19.411811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca8b52-c4ce-466b-a417-5e3deabb1ff2 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:19.461779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49425aaa-2be9-4d6e-8cab-20729616c7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:19.462496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49425aaa-2be9-4d6e-8cab-20729616c7e7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.462736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49425aaa-2be9-4d6e-8cab-20729616c7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.463055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49425aaa-2be9-4d6e-8cab-20729616c7e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.488171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:19.509979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de52e3-73a7-465c-98cf-a5e7305ce979 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:19.543767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:19.560043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:19.560917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.561373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.561819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.562710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:19.563188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:19.564764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:19.565860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49425aaa-2be9-4d6e-8cab-20729616c7e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:19.568327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49425aaa-2be9-4d6e-8cab-20729616c7e7 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:19.578806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 126/247] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:19.583559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:19.703434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4916e0-3d62-49ac-8c50-0c3e9fc2c8d5 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:19.736488 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 122/248] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:15:19.741689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49425aaa-2be9-4d6e-8cab-20729616c7e7 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:19.742415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5682a-02c4-4649-8524-35e4f8e43a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:19.743283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5682a-02c4-4649-8524-35e4f8e43a3a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.743875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5682a-02c4-4649-8524-35e4f8e43a3a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.744378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5682a-02c4-4649-8524-35e4f8e43a3a None admin] PATH_INFO: `/v3/users/f81414ec2db54135a1ea3b31e5ee6d29` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.745735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5682a-02c4-4649-8524-35e4f8e43a3a None admin] RBAC: Authorizing `identity:get_user(user_id=f81414ec2db54135a1ea3b31e5ee6d29)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:19.747641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5682a-02c4-4649-8524-35e4f8e43a3a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:19.754114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 127/249] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:19 2022] GET /identity/v3/users/f81414ec2db54135a1ea3b31e5ee6d29 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:19.756312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5682a-02c4-4649-8524-35e4f8e43a3a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:19.842239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:19.872545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:19.935711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49425aaa-2be9-4d6e-8cab-20729616c7e7 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:19.941744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5682a-02c4-4649-8524-35e4f8e43a3a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:19.970669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a4dae-e755-4972-9472-dfbc746be844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:19.971299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4dae-e755-4972-9472-dfbc746be844 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.971576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4dae-e755-4972-9472-dfbc746be844 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.971841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4dae-e755-4972-9472-dfbc746be844 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.972963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a4dae-e755-4972-9472-dfbc746be844 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:19.975067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a4dae-e755-4972-9472-dfbc746be844 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:19.977027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 123/250] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:19 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:19.978343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacfdcf-faf2-43bb-9287-eec9074696f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:19.979141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfdcf-faf2-43bb-9287-eec9074696f6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.979570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfdcf-faf2-43bb-9287-eec9074696f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.979988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfdcf-faf2-43bb-9287-eec9074696f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.982298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f8582-1479-4f94-a4db-0b91f197d2f2 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.982622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f8582-1479-4f94-a4db-0b91f197d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.982898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f8582-1479-4f94-a4db-0b91f197d2f2 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.991947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 124/251] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:19.991947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c648-45f4-48c1-b971-3b24082b39e9 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:19.991947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c648-45f4-48c1-b971-3b24082b39e9 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:19.991947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c648-45f4-48c1-b971-3b24082b39e9 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:19.991947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 125/252] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:19.991947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63c648-45f4-48c1-b971-3b24082b39e9 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:20.069295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacfdcf-faf2-43bb-9287-eec9074696f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:20.071968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacfdcf-faf2-43bb-9287-eec9074696f6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:20.108892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63c648-45f4-48c1-b971-3b24082b39e9 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:20.130119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:20.134516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:20.154726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fb230-def5-4162-a63c-ca9e33f0cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:20.155394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fb230-def5-4162-a63c-ca9e33f0cf77 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:20.155674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fb230-def5-4162-a63c-ca9e33f0cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:20.156289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fb230-def5-4162-a63c-ca9e33f0cf77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:20.157597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fb230-def5-4162-a63c-ca9e33f0cf77 None admin] RBAC: Adding query filter params (role.id=8a7ad38a846e4411ac1dcc42523f6085, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512, user.id=8ed73a6381b04d71b3ac1e13c03a156d) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:20.158225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fb230-def5-4162-a63c-ca9e33f0cf77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:20.159867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fb230-def5-4162-a63c-ca9e33f0cf77 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:20.170738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 126/253] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:19 2022] GET /identity/v3/role_assignments?user.id=8ed73a6381b04d71b3ac1e13c03a156d&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=8a7ad38a846e4411ac1dcc42523f6085 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:20.174093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cfadb-8145-4b03-9b93-6a1c4e174d76 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:20.174093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cfadb-8145-4b03-9b93-6a1c4e174d76 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:20.174093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cfadb-8145-4b03-9b93-6a1c4e174d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:20.209495 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-169cfadb-8145-4b03-9b93-6a1c4e174d76 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:20.211501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-169cfadb-8145-4b03-9b93-6a1c4e174d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:20.224898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 128/254] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:20.226221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673e8c7-308a-471b-8d32-a3c589dcb0de None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:20.226509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673e8c7-308a-471b-8d32-a3c589dcb0de None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:20.226781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673e8c7-308a-471b-8d32-a3c589dcb0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:20.263840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c673e8c7-308a-471b-8d32-a3c589dcb0de None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:20.265077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c673e8c7-308a-471b-8d32-a3c589dcb0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:20.323343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 127/255] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:20.324229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cfadb-8145-4b03-9b93-6a1c4e174d76 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:20.404818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 129/256] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:20.406361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673e8c7-308a-471b-8d32-a3c589dcb0de None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:20.479041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cfadb-8145-4b03-9b93-6a1c4e174d76 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:20.491088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:20.518975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4dd66-adea-4cfb-8516-77421f627e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:20.518975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4dd66-adea-4cfb-8516-77421f627e73 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:20.518975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4dd66-adea-4cfb-8516-77421f627e73 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:20.518975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4dd66-adea-4cfb-8516-77421f627e73 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:20.520252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4dd66-adea-4cfb-8516-77421f627e73 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:20.522627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4dd66-adea-4cfb-8516-77421f627e73 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:20.524349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 128/257] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:20 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:20.525112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4dd66-adea-4cfb-8516-77421f627e73 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:20.541775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:20.562423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673e8c7-308a-471b-8d32-a3c589dcb0de None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:20.604012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975a16-b35a-44b6-a7cc-f2039fd128c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:20.604713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975a16-b35a-44b6-a7cc-f2039fd128c5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:20.604999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975a16-b35a-44b6-a7cc-f2039fd128c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:20.605272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975a16-b35a-44b6-a7cc-f2039fd128c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:20.616572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c975a16-b35a-44b6-a7cc-f2039fd128c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-6c975a16-b35a-44b6-a7cc-f2039fd128c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:20.621465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:20.622353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:20.623127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 130/258] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:20.623751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975a16-b35a-44b6-a7cc-f2039fd128c5 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:20.652052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4dd66-adea-4cfb-8516-77421f627e73 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:20.693983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99fc43-ac17-4c25-adf6-b33b54d62f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:20.695342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99fc43-ac17-4c25-adf6-b33b54d62f1a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:20.695622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99fc43-ac17-4c25-adf6-b33b54d62f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:20.695891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99fc43-ac17-4c25-adf6-b33b54d62f1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:20.718187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99fc43-ac17-4c25-adf6-b33b54d62f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-be99fc43-ac17-4c25-adf6-b33b54d62f1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:20.725280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:20.726170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:20.726954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:20.727538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 129/259] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:20.728475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99fc43-ac17-4c25-adf6-b33b54d62f1a None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:20.779997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975a16-b35a-44b6-a7cc-f2039fd128c5 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:20.821579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:20.822649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:20.823142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:20.823606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:20.825330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512, user.id=f81414ec2db54135a1ea3b31e5ee6d29) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:20.826795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:20.834087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:20.843368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 131/260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:20 2022] GET /identity/v3/role_assignments?user.id=f81414ec2db54135a1ea3b31e5ee6d29&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:20.844284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:20.861428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:20.872577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:20.997509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99fc43-ac17-4c25-adf6-b33b54d62f1a None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:21.049560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:21.050120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.050406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.050680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.051356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:21.051691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:21.053160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:21.062220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 130/261] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:21.071819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:21.152090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60375b-6109-4e48-a3a2-592b55216f6d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:21.203589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:21.207540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323a872-5f3e-44eb-875f-1e5b46d4623f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:21.250785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:21.251415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.251696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.251971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.252642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:21.252945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:21.254346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:21.254856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c747-efb7-4f7e-8b24-ce1b6c0e25ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:21.255568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c747-efb7-4f7e-8b24-ce1b6c0e25ce None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.256174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c747-efb7-4f7e-8b24-ce1b6c0e25ce None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.256456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c747-efb7-4f7e-8b24-ce1b6c0e25ce None admin] PATH_INFO: `/v3/users/f81414ec2db54135a1ea3b31e5ee6d29` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.258252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673c747-efb7-4f7e-8b24-ce1b6c0e25ce None admin] RBAC: Authorizing `identity:get_user(user_id=f81414ec2db54135a1ea3b31e5ee6d29)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:21.259705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673c747-efb7-4f7e-8b24-ce1b6c0e25ce None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:21.262417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 131/262] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:21 2022] GET /identity/v3/users/f81414ec2db54135a1ea3b31e5ee6d29 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:21.263496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 132/263] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:21.267871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c747-efb7-4f7e-8b24-ce1b6c0e25ce None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:21.271022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:21.415897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:21.453515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c747-efb7-4f7e-8b24-ce1b6c0e25ce None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:21.497632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b51b2c-2db0-4e60-a5fd-634c48989607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:21.499161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51b2c-2db0-4e60-a5fd-634c48989607 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.499627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51b2c-2db0-4e60-a5fd-634c48989607 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.500250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51b2c-2db0-4e60-a5fd-634c48989607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.515648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde706f-149d-4e0a-9561-e25f6761a726 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:21.546492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:21.577709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b51b2c-2db0-4e60-a5fd-634c48989607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:21.579621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b51b2c-2db0-4e60-a5fd-634c48989607 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:21.604453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686786-46f5-43e4-974b-497cc1933690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:21.605098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686786-46f5-43e4-974b-497cc1933690 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.605431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686786-46f5-43e4-974b-497cc1933690 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.605649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686786-46f5-43e4-974b-497cc1933690 None admin] PATH_INFO: `/v3/users/23f6be29dbdd49e79d79c2d0d20f9d98` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.614908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94686786-46f5-43e4-974b-497cc1933690 None admin] RBAC: Authorizing `identity:get_user(user_id=23f6be29dbdd49e79d79c2d0d20f9d98)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:21.616871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94686786-46f5-43e4-974b-497cc1933690 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:21.618407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 133/264] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:21 2022] GET /identity/v3/users/23f6be29dbdd49e79d79c2d0d20f9d98 => generated 297 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:21.627750 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686786-46f5-43e4-974b-497cc1933690 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:21.692876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 132/265] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:21.707525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b51b2c-2db0-4e60-a5fd-634c48989607 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:21.758441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686786-46f5-43e4-974b-497cc1933690 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:21.793683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8703fdb-59be-403b-a7c5-971d7c278d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:21.794351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8703fdb-59be-403b-a7c5-971d7c278d99 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.794640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8703fdb-59be-403b-a7c5-971d7c278d99 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.794917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8703fdb-59be-403b-a7c5-971d7c278d99 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.796065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8703fdb-59be-403b-a7c5-971d7c278d99 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:21.797509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8703fdb-59be-403b-a7c5-971d7c278d99 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:21.799507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 134/266] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:21 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:21.805602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aac81-d920-4468-a089-493cad78bee4 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.805602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aac81-d920-4468-a089-493cad78bee4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.805602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aac81-d920-4468-a089-493cad78bee4 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.805602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 135/267] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:21.806894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aac81-d920-4468-a089-493cad78bee4 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:21.810630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:21.821353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:21.864910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b51b2c-2db0-4e60-a5fd-634c48989607 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:21.902125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5fb0d-4c86-49a3-8c8f-33a4958fffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:21.902876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fb0d-4c86-49a3-8c8f-33a4958fffdd None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.903164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fb0d-4c86-49a3-8c8f-33a4958fffdd None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.903497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fb0d-4c86-49a3-8c8f-33a4958fffdd None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.904634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5fb0d-4c86-49a3-8c8f-33a4958fffdd None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:21.906117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5fb0d-4c86-49a3-8c8f-33a4958fffdd None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:21.912654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 133/268] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:21 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:21.913868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc221-44e3-469b-85d9-45ee433725e8 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.914193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc221-44e3-469b-85d9-45ee433725e8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.914704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc221-44e3-469b-85d9-45ee433725e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.933261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-cf9fc221-44e3-469b-85d9-45ee433725e8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:21.934486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cf9fc221-44e3-469b-85d9-45ee433725e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:21.942978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aac81-d920-4468-a089-493cad78bee4 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:21.989373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0e4b2-c890-4d04-a0ed-3da606f8a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:21.990037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e4b2-c890-4d04-a0ed-3da606f8a311 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:21.990344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e4b2-c890-4d04-a0ed-3da606f8a311 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:21.990614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e4b2-c890-4d04-a0ed-3da606f8a311 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/users/23f6be29dbdd49e79d79c2d0d20f9d98/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:21.992490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0e4b2-c890-4d04-a0ed-3da606f8a311 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4f3487ce94cc4b6371ef214d4c512, user_id=23f6be29dbdd49e79d79c2d0d20f9d98, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:21.993925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0e4b2-c890-4d04-a0ed-3da606f8a311 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:22.005886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 134/269] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:22.006763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fc221-44e3-469b-85d9-45ee433725e8 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:22.013352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 136/270] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:21 2022] PUT /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/users/23f6be29dbdd49e79d79c2d0d20f9d98/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:22.013352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f754c-04eb-475a-ba90-5e7c7066ca3c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.013352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f754c-04eb-475a-ba90-5e7c7066ca3c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.013352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f754c-04eb-475a-ba90-5e7c7066ca3c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.013352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 137/271] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:22.020161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d19903-c919-4758-9310-83434006a798 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.022846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d19903-c919-4758-9310-83434006a798 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.023133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d19903-c919-4758-9310-83434006a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.048746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-29d19903-c919-4758-9310-83434006a798 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:22.050355 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-29d19903-c919-4758-9310-83434006a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:22.093209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:22.142671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fc221-44e3-469b-85d9-45ee433725e8 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:22.143547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:22.158226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 138/272] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:22.163059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d19903-c919-4758-9310-83434006a798 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:22.202911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:22.203895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.204390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.204733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.205468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] RBAC: Adding query filter params (role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512, user.id=f81414ec2db54135a1ea3b31e5ee6d29) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:22.205780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:22.208228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:22.222094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 135/273] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:22 2022] GET /identity/v3/role_assignments?user.id=f81414ec2db54135a1ea3b31e5ee6d29&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=45f0e969ef594665877c4596781ce6aa => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:22.222094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:22.331213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d19903-c919-4758-9310-83434006a798 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:22.407279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068c90-b6d3-4774-8c80-a83fe5d0e351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:22.408198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a7fe1-df27-4e21-87fb-1f21dda714e9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:22.409045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068c90-b6d3-4774-8c80-a83fe5d0e351 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.411696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068c90-b6d3-4774-8c80-a83fe5d0e351 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.412175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068c90-b6d3-4774-8c80-a83fe5d0e351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.434264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4068c90-b6d3-4774-8c80-a83fe5d0e351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-b4068c90-b6d3-4774-8c80-a83fe5d0e351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:22.440321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:22.441190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:22.442004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:22.446338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 139/274] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:22.449299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068c90-b6d3-4774-8c80-a83fe5d0e351 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:22.453710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:22.462323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd126356-61d9-479d-9e77-17e478592c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:22.464254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd126356-61d9-479d-9e77-17e478592c37 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.464754 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd126356-61d9-479d-9e77-17e478592c37 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.465182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd126356-61d9-479d-9e77-17e478592c37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.466980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd126356-61d9-479d-9e77-17e478592c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:22.468753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd126356-61d9-479d-9e77-17e478592c37 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:22.471047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 136/275] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:22.477139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd126356-61d9-479d-9e77-17e478592c37 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:22.533523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:22.592851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068c90-b6d3-4774-8c80-a83fe5d0e351 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:22.628053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd126356-61d9-479d-9e77-17e478592c37 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:22.639222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:22.640040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.640413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.640791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.641926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:22.642382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:22.645193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:22.658158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 140/276] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:22.664795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:22.682246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae49a2b-fc52-4382-ae26-59777f993dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:22.683261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49a2b-fc52-4382-ae26-59777f993dc9 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.683547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49a2b-fc52-4382-ae26-59777f993dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.683824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49a2b-fc52-4382-ae26-59777f993dc9 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.684619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae49a2b-fc52-4382-ae26-59777f993dc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:22.686274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae49a2b-fc52-4382-ae26-59777f993dc9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:22.715137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 137/277] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:22 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:15:22.716282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1f66-ce8e-49b8-8a57-a3ef309981e4 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.716526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1f66-ce8e-49b8-8a57-a3ef309981e4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.716799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1f66-ce8e-49b8-8a57-a3ef309981e4 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.718176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 138/278] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:22.723861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333d4e9-719d-4088-b121-610648c4c87d None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.724193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333d4e9-719d-4088-b121-610648c4c87d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.724420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333d4e9-719d-4088-b121-610648c4c87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.748271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7333d4e9-719d-4088-b121-610648c4c87d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:22.749492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7333d4e9-719d-4088-b121-610648c4c87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:22.809710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421a587-a711-4d2b-992a-72f6657d8459 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:22.830525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:22.833245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:22.834185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 139/279] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:22.853671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333d4e9-719d-4088-b121-610648c4c87d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:22.858103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caad92c-125b-4ba8-8f93-8e1884c6c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:22.859128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad92c-125b-4ba8-8f93-8e1884c6c837 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:22.859606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad92c-125b-4ba8-8f93-8e1884c6c837 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:22.860158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad92c-125b-4ba8-8f93-8e1884c6c837 None admin] PATH_INFO: `/v3/users/53c26dfe31bc44adb198c17ee7686793` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:22.882979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caad92c-125b-4ba8-8f93-8e1884c6c837 None admin] RBAC: Authorizing `identity:get_user(user_id=53c26dfe31bc44adb198c17ee7686793)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:22.884527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caad92c-125b-4ba8-8f93-8e1884c6c837 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:22.886558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 141/280] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:22 2022] GET /identity/v3/users/53c26dfe31bc44adb198c17ee7686793 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:22.892214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caad92c-125b-4ba8-8f93-8e1884c6c837 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:23.007782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333d4e9-719d-4088-b121-610648c4c87d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:23.010374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caad92c-125b-4ba8-8f93-8e1884c6c837 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:23.058175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:23.058407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcae95-f0e6-4b0d-85e1-346fb15c20fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:23.058785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:23.059066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:23.059255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcae95-f0e6-4b0d-85e1-346fb15c20fa None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:23.059357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:23.059693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcae95-f0e6-4b0d-85e1-346fb15c20fa None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:23.060045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] RBAC: Adding query filter params (role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, user.id=53c26dfe31bc44adb198c17ee7686793, scope.system=all) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:23.060160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcae95-f0e6-4b0d-85e1-346fb15c20fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:23.060357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:23.061781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:23.068914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 142/281] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 8 00:15:22 2022] GET /identity/v3/role_assignments?user.id=53c26dfe31bc44adb198c17ee7686793&scope.system=all&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:23.074493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcae95-f0e6-4b0d-85e1-346fb15c20fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-6ddcae95-f0e6-4b0d-85e1-346fb15c20fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:23.079516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:23.080461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:23.081233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 140/282] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:23.086912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:23.133243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:23.203948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b18e9-a6a9-4233-86ae-f4ae9939da38 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:23.242271 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:23.242891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:23.245747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:23.245747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:23.245747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:23.245747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:23.245747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:23.254752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 143/283] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:23.261073 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcae95-f0e6-4b0d-85e1-346fb15c20fa None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:23.320189 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:23.399236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcae95-f0e6-4b0d-85e1-346fb15c20fa None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:23.454252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260ce61-9b5d-4ed3-bcfd-63fa493588b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:23.454884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260ce61-9b5d-4ed3-bcfd-63fa493588b7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:23.455166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260ce61-9b5d-4ed3-bcfd-63fa493588b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:23.455438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260ce61-9b5d-4ed3-bcfd-63fa493588b7 None admin] PATH_INFO: `/v3/users/8ed73a6381b04d71b3ac1e13c03a156d` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:23.456577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260ce61-9b5d-4ed3-bcfd-63fa493588b7 None admin] RBAC: Authorizing `identity:get_user(user_id=8ed73a6381b04d71b3ac1e13c03a156d)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:23.458626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260ce61-9b5d-4ed3-bcfd-63fa493588b7 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:23.460367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 141/284] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:23 2022] GET /identity/v3/users/8ed73a6381b04d71b3ac1e13c03a156d => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:23.465865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:23.617015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:23.619854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6eeb3-7dba-4bde-8c5e-2181c6545c52 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:23.669457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545aa888-1f5a-48b4-8ba1-4cb14dd8ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:23.670119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aa888-1f5a-48b4-8ba1-4cb14dd8ea86 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:23.670398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aa888-1f5a-48b4-8ba1-4cb14dd8ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:23.670668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aa888-1f5a-48b4-8ba1-4cb14dd8ea86 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:23.671798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545aa888-1f5a-48b4-8ba1-4cb14dd8ea86 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:23.673230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545aa888-1f5a-48b4-8ba1-4cb14dd8ea86 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:23.675206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 144/285] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:23 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:23.680651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260ce61-9b5d-4ed3-bcfd-63fa493588b7 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:23.844869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260ce61-9b5d-4ed3-bcfd-63fa493588b7 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:23.868812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:23.899995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c78a7f-496f-46f3-b99c-343e51f2a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:23.900654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78a7f-496f-46f3-b99c-343e51f2a9b6 None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:23.900937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78a7f-496f-46f3-b99c-343e51f2a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:23.901216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78a7f-496f-46f3-b99c-343e51f2a9b6 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/users/8ed73a6381b04d71b3ac1e13c03a156d/roles/8a7ad38a846e4411ac1dcc42523f6085` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:23.907333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c78a7f-496f-46f3-b99c-343e51f2a9b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4f3487ce94cc4b6371ef214d4c512, user_id=8ed73a6381b04d71b3ac1e13c03a156d, role_id=8a7ad38a846e4411ac1dcc42523f6085)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:23.908785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c78a7f-496f-46f3-b99c-343e51f2a9b6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:23.933918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 142/286] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:15:23 2022] PUT /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/users/8ed73a6381b04d71b3ac1e13c03a156d/roles/8a7ad38a846e4411ac1dcc42523f6085 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:24.470584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2484e0-c610-470e-b6ed-9fb49b040838 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:24.471124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2484e0-c610-470e-b6ed-9fb49b040838 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:24.471124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2484e0-c610-470e-b6ed-9fb49b040838 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:24.472466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 145/287] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:24.479155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457b06-bc5f-4fc6-8545-926c9f8b95d4 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:24.479449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457b06-bc5f-4fc6-8545-926c9f8b95d4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:24.479727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457b06-bc5f-4fc6-8545-926c9f8b95d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:24.506353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-eb457b06-bc5f-4fc6-8545-926c9f8b95d4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:24.507539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-eb457b06-bc5f-4fc6-8545-926c9f8b95d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:24.580788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 143/288] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:24.615784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2484e0-c610-470e-b6ed-9fb49b040838 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:24.755838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2484e0-c610-470e-b6ed-9fb49b040838 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:24.799064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3707b-c9fa-4b42-9095-9742ce8f7ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:24.799693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3707b-c9fa-4b42-9095-9742ce8f7ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:24.799977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3707b-c9fa-4b42-9095-9742ce8f7ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:24.800250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3707b-c9fa-4b42-9095-9742ce8f7ec9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:24.817925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3707b-c9fa-4b42-9095-9742ce8f7ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-12e3707b-c9fa-4b42-9095-9742ce8f7ec9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:24.822791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:24.823633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:24.824413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 146/289] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:24.830026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb457b06-bc5f-4fc6-8545-926c9f8b95d4 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:24.961116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb457b06-bc5f-4fc6-8545-926c9f8b95d4 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:24.962702 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:25.005191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:25.005813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.006163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.006388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.007063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] RBAC: Adding query filter params (name=member) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:25.007367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:25.008749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:25.019198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 144/290] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:25.025115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3707b-c9fa-4b42-9095-9742ce8f7ec9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:25.073023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:25.177829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3707b-c9fa-4b42-9095-9742ce8f7ec9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:25.226771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40988ada-b640-438f-a846-1fe040a22db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:25.227413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988ada-b640-438f-a846-1fe040a22db7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.227705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988ada-b640-438f-a846-1fe040a22db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.227983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988ada-b640-438f-a846-1fe040a22db7 None admin] PATH_INFO: `/v3/users/23f6be29dbdd49e79d79c2d0d20f9d98` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.229149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40988ada-b640-438f-a846-1fe040a22db7 None admin] RBAC: Authorizing `identity:get_user(user_id=23f6be29dbdd49e79d79c2d0d20f9d98)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:25.230633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40988ada-b640-438f-a846-1fe040a22db7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:25.232596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 147/291] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:25 2022] GET /identity/v3/users/23f6be29dbdd49e79d79c2d0d20f9d98 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:25.237752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:25.350058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abbe31-cbfc-4113-9a0c-4a44a1761a2c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.350383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abbe31-cbfc-4113-9a0c-4a44a1761a2c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.350586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abbe31-cbfc-4113-9a0c-4a44a1761a2c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.352178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 148/292] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:25.356959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae9cbf-f0cb-43d0-a4c6-506c69a0e32f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.357238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae9cbf-f0cb-43d0-a4c6-506c69a0e32f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.357514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae9cbf-f0cb-43d0-a4c6-506c69a0e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.383086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b9ae9cbf-f0cb-43d0-a4c6-506c69a0e32f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:25.384271 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b9ae9cbf-f0cb-43d0-a4c6-506c69a0e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:25.424209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da3c41-c8d7-4b80-b867-15e3fb76d274 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:25.481517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86ef7-e87e-40ce-b377-885422e2c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:25.482152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86ef7-e87e-40ce-b377-885422e2c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.482438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86ef7-e87e-40ce-b377-885422e2c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.482712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86ef7-e87e-40ce-b377-885422e2c5e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.501048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 149/293] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:25.502508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16f8d-f61e-459e-acd3-30292bc24828 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.502799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16f8d-f61e-459e-acd3-30292bc24828 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.503078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16f8d-f61e-459e-acd3-30292bc24828 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.508581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 150/294] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:25.510437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ad7e-1852-47ab-b112-436bb0c72b54 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.510725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ad7e-1852-47ab-b112-436bb0c72b54 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.511001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ad7e-1852-47ab-b112-436bb0c72b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.532741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b581ad7e-1852-47ab-b112-436bb0c72b54 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:25.534099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b581ad7e-1852-47ab-b112-436bb0c72b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:25.546345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:25.561074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:25.600505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed86ef7-e87e-40ce-b377-885422e2c5e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:25.602202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed86ef7-e87e-40ce-b377-885422e2c5e4 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:25.622324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 151/295] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:25.623595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581ad7e-1852-47ab-b112-436bb0c72b54 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:25.732001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 145/296] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:25.732923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86ef7-e87e-40ce-b377-885422e2c5e4 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:25.751506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581ad7e-1852-47ab-b112-436bb0c72b54 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:25.788940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbf4f4-95d8-45c9-bf52-1b072ec9ef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:25.789577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbf4f4-95d8-45c9-bf52-1b072ec9ef27 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.789857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbf4f4-95d8-45c9-bf52-1b072ec9ef27 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.790156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbf4f4-95d8-45c9-bf52-1b072ec9ef27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.800317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbf4f4-95d8-45c9-bf52-1b072ec9ef27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:25.804383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-f9dbf4f4-95d8-45c9-bf52-1b072ec9ef27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:25.805148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:25.806010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:25.806979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:25.811612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 152/297] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:25.812451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbf4f4-95d8-45c9-bf52-1b072ec9ef27 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:25.836266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:25.849423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86ef7-e87e-40ce-b377-885422e2c5e4 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:25.888237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945c047-a69a-49fe-ae2e-01a488d4d438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:25.888875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c047-a69a-49fe-ae2e-01a488d4d438 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.889157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c047-a69a-49fe-ae2e-01a488d4d438 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.889435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c047-a69a-49fe-ae2e-01a488d4d438 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.900683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945c047-a69a-49fe-ae2e-01a488d4d438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-1945c047-a69a-49fe-ae2e-01a488d4d438 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:25.905392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:25.906349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:25.907137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 146/298] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:25.912423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e04a-c0c5-4bb2-8985-28aea078b042 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.912741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e04a-c0c5-4bb2-8985-28aea078b042 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.912997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e04a-c0c5-4bb2-8985-28aea078b042 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.918345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 147/299] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:25.918345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e04a-c0c5-4bb2-8985-28aea078b042 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:25.936814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbf4f4-95d8-45c9-bf52-1b072ec9ef27 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:25.974735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc5b9-6c65-4f59-8092-ac2159dcac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:25.975360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc5b9-6c65-4f59-8092-ac2159dcac3b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:25.975637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc5b9-6c65-4f59-8092-ac2159dcac3b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:25.975906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc5b9-6c65-4f59-8092-ac2159dcac3b None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:25.977001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc5b9-6c65-4f59-8092-ac2159dcac3b None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:25.978465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc5b9-6c65-4f59-8092-ac2159dcac3b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:25.980077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 153/300] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:25 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:25.980829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc5b9-6c65-4f59-8092-ac2159dcac3b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.030009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e04a-c0c5-4bb2-8985-28aea078b042 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.054727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:26.066245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8850-3f12-4a97-b66a-6fd2c71c8ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.067623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8850-3f12-4a97-b66a-6fd2c71c8ae9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.068075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8850-3f12-4a97-b66a-6fd2c71c8ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.068513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8850-3f12-4a97-b66a-6fd2c71c8ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.069312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8850-3f12-4a97-b66a-6fd2c71c8ae9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:26.069769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8850-3f12-4a97-b66a-6fd2c71c8ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.071322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8850-3f12-4a97-b66a-6fd2c71c8ae9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.074911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:26.080369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 148/301] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:26.080369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80cc5-f059-4861-b6be-7c0c5cdffa54 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.080369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80cc5-f059-4861-b6be-7c0c5cdffa54 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.080369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80cc5-f059-4861-b6be-7c0c5cdffa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.098197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc5b9-6c65-4f59-8092-ac2159dcac3b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.101049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-16b80cc5-f059-4861-b6be-7c0c5cdffa54 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:26.101591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-16b80cc5-f059-4861-b6be-7c0c5cdffa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:26.134805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.135335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.135623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.135884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.136533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:26.136840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.138250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.147531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 154/302] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:26.152147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.180112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 149/303] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:26.190281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80cc5-f059-4861-b6be-7c0c5cdffa54 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.257333 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741df60-3d4b-485b-9431-886ea62df158 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.294433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.295035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.295313 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.295581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.296293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] RBAC: Adding query filter params (role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512, user.id=23f6be29dbdd49e79d79c2d0d20f9d98) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:26.296597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.298021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.304086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 155/304] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:26 2022] GET /identity/v3/role_assignments?user.id=23f6be29dbdd49e79d79c2d0d20f9d98&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:26.304859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.305751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80cc5-f059-4861-b6be-7c0c5cdffa54 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.329646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:26.337895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:26.364948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73ab28-f1fb-443e-8fd7-16be1dc8a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.365673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ab28-f1fb-443e-8fd7-16be1dc8a094 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.365956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ab28-f1fb-443e-8fd7-16be1dc8a094 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.366265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ab28-f1fb-443e-8fd7-16be1dc8a094 None admin] PATH_INFO: `/v3/users/3a45e5c8c2bd4494b00aca4ec3e731d4` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.387482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73ab28-f1fb-443e-8fd7-16be1dc8a094 None admin] RBAC: Authorizing `identity:get_user(user_id=3a45e5c8c2bd4494b00aca4ec3e731d4)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.389172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73ab28-f1fb-443e-8fd7-16be1dc8a094 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.392183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 150/305] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:26 2022] GET /identity/v3/users/3a45e5c8c2bd4494b00aca4ec3e731d4 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:26.392837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73ab28-f1fb-443e-8fd7-16be1dc8a094 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.437149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3559bf-1ad7-446b-90bf-3fb73fae8db1 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.477324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8870a-4be2-4fd6-b722-2c7964fbb3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.478246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8870a-4be2-4fd6-b722-2c7964fbb3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.478525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8870a-4be2-4fd6-b722-2c7964fbb3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.478796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8870a-4be2-4fd6-b722-2c7964fbb3f9 None admin] PATH_INFO: `/v3/users/53c26dfe31bc44adb198c17ee7686793` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.480016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8870a-4be2-4fd6-b722-2c7964fbb3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=53c26dfe31bc44adb198c17ee7686793)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.481780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8870a-4be2-4fd6-b722-2c7964fbb3f9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.483464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 156/306] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:26 2022] GET /identity/v3/users/53c26dfe31bc44adb198c17ee7686793 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:26.484236 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8870a-4be2-4fd6-b722-2c7964fbb3f9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.530666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73ab28-f1fb-443e-8fd7-16be1dc8a094 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.568882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efaab0-b84d-47cf-8433-46a2ae88d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.569505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efaab0-b84d-47cf-8433-46a2ae88d942 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.569782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efaab0-b84d-47cf-8433-46a2ae88d942 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.570049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efaab0-b84d-47cf-8433-46a2ae88d942 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.571188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efaab0-b84d-47cf-8433-46a2ae88d942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.572618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efaab0-b84d-47cf-8433-46a2ae88d942 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.573220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:26.574246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 151/307] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:26.575470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a6cd3-2821-4f2b-96e7-796b627ffd62 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.575858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a6cd3-2821-4f2b-96e7-796b627ffd62 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.576106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a6cd3-2821-4f2b-96e7-796b627ffd62 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.578113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 152/308] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:26.578314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a6cd3-2821-4f2b-96e7-796b627ffd62 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.599930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8870a-4be2-4fd6-b722-2c7964fbb3f9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.623448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:26.633070 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.633673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.633955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.634259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.634974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] RBAC: Adding query filter params (role.id=8a7ad38a846e4411ac1dcc42523f6085, user.id=3a45e5c8c2bd4494b00aca4ec3e731d4, scope.system=all) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:26.635286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.636705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.641553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 157/309] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 8 00:15:26 2022] GET /identity/v3/role_assignments?user.id=3a45e5c8c2bd4494b00aca4ec3e731d4&scope.system=all&role.id=8a7ad38a846e4411ac1dcc42523f6085 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:26.642278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.687457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a6cd3-2821-4f2b-96e7-796b627ffd62 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.726608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99a4bd-01f8-448b-8301-cbb10d93b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.727279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99a4bd-01f8-448b-8301-cbb10d93b5ed None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.727559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99a4bd-01f8-448b-8301-cbb10d93b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.727833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99a4bd-01f8-448b-8301-cbb10d93b5ed None admin] PATH_INFO: `/v3/system/users/53c26dfe31bc44adb198c17ee7686793/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.729340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99a4bd-01f8-448b-8301-cbb10d93b5ed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=53c26dfe31bc44adb198c17ee7686793, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.730801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99a4bd-01f8-448b-8301-cbb10d93b5ed None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.741683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 153/310] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Aug 8 00:15:26 2022] PUT /identity/v3/system/users/53c26dfe31bc44adb198c17ee7686793/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:26.742814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57136dd-cae9-4472-87d2-e44ab2b46ee2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.743104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57136dd-cae9-4472-87d2-e44ab2b46ee2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.743434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57136dd-cae9-4472-87d2-e44ab2b46ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.768789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80feb-c244-420a-a229-0defc0ecf9bf None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:26.770705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b57136dd-cae9-4472-87d2-e44ab2b46ee2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:26.772304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b57136dd-cae9-4472-87d2-e44ab2b46ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:26.820720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244a2d7-9df3-47fc-bf36-c55e2f30a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:26.821746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244a2d7-9df3-47fc-bf36-c55e2f30a3b1 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:26.822827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244a2d7-9df3-47fc-bf36-c55e2f30a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:26.823340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244a2d7-9df3-47fc-bf36-c55e2f30a3b1 None admin] PATH_INFO: `/v3/groups` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:26.824144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244a2d7-9df3-47fc-bf36-c55e2f30a3b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:26.827322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244a2d7-9df3-47fc-bf36-c55e2f30a3b1 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:26.858098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 158/311] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Aug 8 00:15:26 2022] POST /identity/v3/groups => generated 229 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:26.880364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 154/312] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:26.905454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244a2d7-9df3-47fc-bf36-c55e2f30a3b1 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:26.910322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:27.022028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244a2d7-9df3-47fc-bf36-c55e2f30a3b1 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:27.057715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef75ba-ce00-40ba-99b6-2367f0a026ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:27.058455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef75ba-ce00-40ba-99b6-2367f0a026ab None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:27.058734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef75ba-ce00-40ba-99b6-2367f0a026ab None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:27.059008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef75ba-ce00-40ba-99b6-2367f0a026ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:27.071230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef75ba-ce00-40ba-99b6-2367f0a026ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-7bef75ba-ce00-40ba-99b6-2367f0a026ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:27.076848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:27.077773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:27.078586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:27.082135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 159/313] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:27.084352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57136dd-cae9-4472-87d2-e44ab2b46ee2 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:27.124581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:27.195517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57136dd-cae9-4472-87d2-e44ab2b46ee2 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:27.231586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:27.232249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:27.232534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:27.232805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:27.233467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:27.233767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:27.235204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:27.244212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 155/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:27.251368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef75ba-ce00-40ba-99b6-2367f0a026ab None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:27.318447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:27.358655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef75ba-ce00-40ba-99b6-2367f0a026ab None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:27.394407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904e13-ed81-4f22-8a08-758b0256c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:27.395990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904e13-ed81-4f22-8a08-758b0256c644 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:27.396268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904e13-ed81-4f22-8a08-758b0256c644 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:27.396536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904e13-ed81-4f22-8a08-758b0256c644 None admin] PATH_INFO: `/v3/users/8ed73a6381b04d71b3ac1e13c03a156d` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:27.397659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904e13-ed81-4f22-8a08-758b0256c644 None admin] RBAC: Authorizing `identity:get_user(user_id=8ed73a6381b04d71b3ac1e13c03a156d)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:27.399207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904e13-ed81-4f22-8a08-758b0256c644 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:27.401247 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 160/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:27 2022] GET /identity/v3/users/8ed73a6381b04d71b3ac1e13c03a156d => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:27.406508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:27.506297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:27.509738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74360f42-eb6f-444a-85f9-7b1a374b0438 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:27.544894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5a031-7118-44ba-8f81-f03996aaab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:27.545491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a031-7118-44ba-8f81-f03996aaab6b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:27.545767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a031-7118-44ba-8f81-f03996aaab6b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:27.546034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a031-7118-44ba-8f81-f03996aaab6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:27.618652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5a031-7118-44ba-8f81-f03996aaab6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:27.620203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5a031-7118-44ba-8f81-f03996aaab6b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:27.718706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:27.721779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 156/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:27.728342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904e13-ed81-4f22-8a08-758b0256c644 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:27.835721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904e13-ed81-4f22-8a08-758b0256c644 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:27.876299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:27.882934 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5ec5b-b2aa-4f94-8340-af3a79d0381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:27.883571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5ec5b-b2aa-4f94-8340-af3a79d0381f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:27.883850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5ec5b-b2aa-4f94-8340-af3a79d0381f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:27.884123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5ec5b-b2aa-4f94-8340-af3a79d0381f None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:27.885244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5ec5b-b2aa-4f94-8340-af3a79d0381f None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:27.886776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5ec5b-b2aa-4f94-8340-af3a79d0381f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:27.888413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 161/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:27 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:27.899139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5a031-7118-44ba-8f81-f03996aaab6b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:28.001605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5a031-7118-44ba-8f81-f03996aaab6b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:28.037399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff99b-1f64-4c6f-99af-c2d8737002e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:28.037996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff99b-1f64-4c6f-99af-c2d8737002e5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:28.038306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff99b-1f64-4c6f-99af-c2d8737002e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:28.038581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff99b-1f64-4c6f-99af-c2d8737002e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:28.039304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ff99b-1f64-4c6f-99af-c2d8737002e5 None admin] RBAC: Adding query filter params (role.id=8a7ad38a846e4411ac1dcc42523f6085, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512, user.id=8ed73a6381b04d71b3ac1e13c03a156d) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:28.039614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ff99b-1f64-4c6f-99af-c2d8737002e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:28.041044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ff99b-1f64-4c6f-99af-c2d8737002e5 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:28.047286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 157/318] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:27 2022] GET /identity/v3/role_assignments?user.id=8ed73a6381b04d71b3ac1e13c03a156d&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=8a7ad38a846e4411ac1dcc42523f6085 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:28.735524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbece6-a916-4938-97c4-bcde84107df3 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:28.736036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbece6-a916-4938-97c4-bcde84107df3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:28.736036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbece6-a916-4938-97c4-bcde84107df3 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:28.737543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 162/319] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:28.742500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c0c0-fa29-4f04-ad53-4a612e8b4269 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:28.742794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c0c0-fa29-4f04-ad53-4a612e8b4269 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:28.743073 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c0c0-fa29-4f04-ad53-4a612e8b4269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:28.761457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-bc57c0c0-fa29-4f04-ad53-4a612e8b4269 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:28.762692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-bc57c0c0-fa29-4f04-ad53-4a612e8b4269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:28.812697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7882-3a9e-441e-9cf6-af4207d26e83 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:28.812979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7882-3a9e-441e-9cf6-af4207d26e83 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:28.813257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7882-3a9e-441e-9cf6-af4207d26e83 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:28.814747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 163/320] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:28.819965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c626931-8b03-4fc6-9a0c-303f49016f2a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:28.820253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c626931-8b03-4fc6-9a0c-303f49016f2a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:28.820530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c626931-8b03-4fc6-9a0c-303f49016f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:28.823386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:28.835476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 158/321] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:28.839535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4c626931-8b03-4fc6-9a0c-303f49016f2a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:28.840724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4c626931-8b03-4fc6-9a0c-303f49016f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:28.857190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c0c0-fa29-4f04-ad53-4a612e8b4269 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:28.915699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 164/322] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:28.938232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c626931-8b03-4fc6-9a0c-303f49016f2a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:28.962660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c0c0-fa29-4f04-ad53-4a612e8b4269 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.009573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2055d7-021b-4189-8c16-56b0894a0ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.010165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2055d7-021b-4189-8c16-56b0894a0ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.010442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2055d7-021b-4189-8c16-56b0894a0ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.010715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2055d7-021b-4189-8c16-56b0894a0ce8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.021294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2055d7-021b-4189-8c16-56b0894a0ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-be2055d7-021b-4189-8c16-56b0894a0ce8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:29.025968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:29.026895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:29.027676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 159/323] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:29.028309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af7548-144b-4d51-b947-67535fbcc6a8 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.028911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af7548-144b-4d51-b947-67535fbcc6a8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.028911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af7548-144b-4d51-b947-67535fbcc6a8 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.030642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 160/324] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:29.034935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af7548-144b-4d51-b947-67535fbcc6a8 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:29.044169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c626931-8b03-4fc6-9a0c-303f49016f2a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.071333 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:29.079301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf780b-3df8-4e96-a286-a16e03561bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.079928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf780b-3df8-4e96-a286-a16e03561bbc None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.080213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf780b-3df8-4e96-a286-a16e03561bbc None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.080488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf780b-3df8-4e96-a286-a16e03561bbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.089228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:29.090941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf780b-3df8-4e96-a286-a16e03561bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-5adf780b-3df8-4e96-a286-a16e03561bbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:29.095612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:29.096529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:29.097353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 165/325] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:29.099981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d7dad-6e25-4b3a-a894-48f6ed7d90fe None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.100274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d7dad-6e25-4b3a-a894-48f6ed7d90fe None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.100555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d7dad-6e25-4b3a-a894-48f6ed7d90fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.118398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-382d7dad-6e25-4b3a-a894-48f6ed7d90fe None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:29.119666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-382d7dad-6e25-4b3a-a894-48f6ed7d90fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:29.138154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af7548-144b-4d51-b947-67535fbcc6a8 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.172900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.173494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.173773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.174047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.174730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:29.175030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:29.177051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:29.184951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 161/326] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:29.185721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:29.189474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 166/327] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:29.190529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d7dad-6e25-4b3a-a894-48f6ed7d90fe None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:29.288797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f71b-862b-4292-a16c-88615af0f0ba None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.290987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d7dad-6e25-4b3a-a894-48f6ed7d90fe None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.302985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:29.311625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:29.325804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.326432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.326710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.326977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.327638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:29.327937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:29.328460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55448f-3a7f-403f-bfe6-a679a91a85be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.329087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55448f-3a7f-403f-bfe6-a679a91a85be None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.329308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:29.329406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55448f-3a7f-403f-bfe6-a679a91a85be None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.329625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55448f-3a7f-403f-bfe6-a679a91a85be None admin] PATH_INFO: `/v3/users/3a45e5c8c2bd4494b00aca4ec3e731d4` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.330760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55448f-3a7f-403f-bfe6-a679a91a85be None admin] RBAC: Authorizing `identity:get_user(user_id=3a45e5c8c2bd4494b00aca4ec3e731d4)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:29.332730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55448f-3a7f-403f-bfe6-a679a91a85be None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:29.334359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 167/328] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:29 2022] GET /identity/v3/users/3a45e5c8c2bd4494b00aca4ec3e731d4 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:29.335118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55448f-3a7f-403f-bfe6-a679a91a85be None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:29.337848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 162/329] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:29.340246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:29.434008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55448f-3a7f-403f-bfe6-a679a91a85be None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.439805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121428d-7a94-4b93-8393-7d90ea9181c6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.467655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88585de-8189-474c-90b3-610630f46517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.468274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88585de-8189-474c-90b3-610630f46517 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.468559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88585de-8189-474c-90b3-610630f46517 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.468832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88585de-8189-474c-90b3-610630f46517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.469936 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88585de-8189-474c-90b3-610630f46517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:29.471402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88585de-8189-474c-90b3-610630f46517 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:29.478723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 168/330] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:29.478723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88585de-8189-474c-90b3-610630f46517 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:29.478925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc8fc4-69a1-4863-a4f7-3ed38ac4c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.478925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc8fc4-69a1-4863-a4f7-3ed38ac4c6f4 None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.478925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc8fc4-69a1-4863-a4f7-3ed38ac4c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.478925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc8fc4-69a1-4863-a4f7-3ed38ac4c6f4 None admin] PATH_INFO: `/v3/system/users/3a45e5c8c2bd4494b00aca4ec3e731d4/roles/8a7ad38a846e4411ac1dcc42523f6085` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.479183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc8fc4-69a1-4863-a4f7-3ed38ac4c6f4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3a45e5c8c2bd4494b00aca4ec3e731d4, role_id=8a7ad38a846e4411ac1dcc42523f6085)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:29.479422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc8fc4-69a1-4863-a4f7-3ed38ac4c6f4 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:29.486295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 163/331] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Aug 8 00:15:29 2022] PUT /identity/v3/system/users/3a45e5c8c2bd4494b00aca4ec3e731d4/roles/8a7ad38a846e4411ac1dcc42523f6085 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:15:29.487066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc8fc4-69a1-4863-a4f7-3ed38ac4c6f4 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:29.536569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:29.544765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:29.590434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88585de-8189-474c-90b3-610630f46517 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.611134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc8fc4-69a1-4863-a4f7-3ed38ac4c6f4 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.627950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cefcd-d475-4297-adc5-34e206dd4647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.628696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cefcd-d475-4297-adc5-34e206dd4647 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.629501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cefcd-d475-4297-adc5-34e206dd4647 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.629881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cefcd-d475-4297-adc5-34e206dd4647 None admin] PATH_INFO: `/v3/users/53c26dfe31bc44adb198c17ee7686793` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.631057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cefcd-d475-4297-adc5-34e206dd4647 None admin] RBAC: Authorizing `identity:get_user(user_id=53c26dfe31bc44adb198c17ee7686793)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:29.633071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cefcd-d475-4297-adc5-34e206dd4647 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:29.634641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 169/332] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:29 2022] GET /identity/v3/users/53c26dfe31bc44adb198c17ee7686793 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:29.640341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cefcd-d475-4297-adc5-34e206dd4647 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:29.650840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b7170-fbc6-4054-9f2b-31a0414e5962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.651694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b7170-fbc6-4054-9f2b-31a0414e5962 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.651822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b7170-fbc6-4054-9f2b-31a0414e5962 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.652007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b7170-fbc6-4054-9f2b-31a0414e5962 None admin] PATH_INFO: `/v3/groups` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.652643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b7170-fbc6-4054-9f2b-31a0414e5962 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:29.654175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b7170-fbc6-4054-9f2b-31a0414e5962 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:29.671548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 164/333] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Aug 8 00:15:29 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:29.757083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cefcd-d475-4297-adc5-34e206dd4647 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:29.781954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:29.795794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b2b9-41d0-4fea-bd01-a98008a08c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:29.796323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b2b9-41d0-4fea-bd01-a98008a08c12 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:29.796603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b2b9-41d0-4fea-bd01-a98008a08c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:29.796875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b2b9-41d0-4fea-bd01-a98008a08c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:29.797610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b2b9-41d0-4fea-bd01-a98008a08c12 None admin] RBAC: Adding query filter params (role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, user.id=53c26dfe31bc44adb198c17ee7686793, scope.system=all) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:29.797921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b2b9-41d0-4fea-bd01-a98008a08c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:29.799404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b2b9-41d0-4fea-bd01-a98008a08c12 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:29.812358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 170/334] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 8 00:15:29 2022] GET /identity/v3/role_assignments?user.id=53c26dfe31bc44adb198c17ee7686793&scope.system=all&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:31.725196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3919e9-4183-4fc9-b715-794524af1b7b None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:31.725795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3919e9-4183-4fc9-b715-794524af1b7b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:31.725795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3919e9-4183-4fc9-b715-794524af1b7b None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:31.727374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 165/335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:31.733616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4aaa-ba69-453c-a2bd-a1f4c040955e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:31.734089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4aaa-ba69-453c-a2bd-a1f4c040955e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:31.734190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4aaa-ba69-453c-a2bd-a1f4c040955e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:31.759132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c5cc4aaa-ba69-453c-a2bd-a1f4c040955e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:31.760342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c5cc4aaa-ba69-453c-a2bd-a1f4c040955e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:31.848981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 171/336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:31.882955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3919e9-4183-4fc9-b715-794524af1b7b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:32.008248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:32.012378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3919e9-4183-4fc9-b715-794524af1b7b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:32.051325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26ab70-e6cb-4e05-84af-236202ea26f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:32.051959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ab70-e6cb-4e05-84af-236202ea26f9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.052241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ab70-e6cb-4e05-84af-236202ea26f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.052515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ab70-e6cb-4e05-84af-236202ea26f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.063355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26ab70-e6cb-4e05-84af-236202ea26f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-ec26ab70-e6cb-4e05-84af-236202ea26f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:32.068628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:32.069501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:32.070707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 166/337] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:32.075914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc4aaa-ba69-453c-a2bd-a1f4c040955e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:32.192546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc4aaa-ba69-453c-a2bd-a1f4c040955e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:32.203903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:32.231626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba4230-d4d3-445f-b770-1673487a6a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:32.232245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba4230-d4d3-445f-b770-1673487a6a60 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.232525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba4230-d4d3-445f-b770-1673487a6a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.232795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba4230-d4d3-445f-b770-1673487a6a60 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.233461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba4230-d4d3-445f-b770-1673487a6a60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:32.233761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba4230-d4d3-445f-b770-1673487a6a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:32.235159 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba4230-d4d3-445f-b770-1673487a6a60 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:32.250251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26ab70-e6cb-4e05-84af-236202ea26f9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:32.256245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 172/338] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:32.312704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454b8e3-dc53-4f7f-aef3-a0bb79bb9bff None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.313000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454b8e3-dc53-4f7f-aef3-a0bb79bb9bff None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.313199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454b8e3-dc53-4f7f-aef3-a0bb79bb9bff None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.314578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 173/339] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:32.320608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393cc32-1ae5-46aa-ad17-10381ee5c9ea None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.321206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393cc32-1ae5-46aa-ad17-10381ee5c9ea None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.321726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393cc32-1ae5-46aa-ad17-10381ee5c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.347768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a393cc32-1ae5-46aa-ad17-10381ee5c9ea None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:32.349377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a393cc32-1ae5-46aa-ad17-10381ee5c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:32.381303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26ab70-e6cb-4e05-84af-236202ea26f9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:32.425360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665fef-edf8-461a-9b64-51f3f088eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:32.426556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665fef-edf8-461a-9b64-51f3f088eb23 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.426837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665fef-edf8-461a-9b64-51f3f088eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.427106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665fef-edf8-461a-9b64-51f3f088eb23 None admin] PATH_INFO: `/v3/users/3a45e5c8c2bd4494b00aca4ec3e731d4` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.428317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71665fef-edf8-461a-9b64-51f3f088eb23 None admin] RBAC: Authorizing `identity:get_user(user_id=3a45e5c8c2bd4494b00aca4ec3e731d4)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:32.429778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71665fef-edf8-461a-9b64-51f3f088eb23 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:32.431860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 167/340] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:15:32 2022] GET /identity/v3/users/3a45e5c8c2bd4494b00aca4ec3e731d4 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:32.439558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665fef-edf8-461a-9b64-51f3f088eb23 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:32.481002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:32.500656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 174/341] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:32.502034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c9b1f-71f7-4548-bcb5-de64d4917379 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.502337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c9b1f-71f7-4548-bcb5-de64d4917379 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.502620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c9b1f-71f7-4548-bcb5-de64d4917379 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.508369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 175/342] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:32.509880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0dfe7-3876-4dc8-a940-6be96057eabe None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.510194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0dfe7-3876-4dc8-a940-6be96057eabe None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.510467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0dfe7-3876-4dc8-a940-6be96057eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.560905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-cdd0dfe7-3876-4dc8-a940-6be96057eabe None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:32.562125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cdd0dfe7-3876-4dc8-a940-6be96057eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:32.600816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665fef-edf8-461a-9b64-51f3f088eb23 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:32.665559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25394d47-cfa6-4ad2-ac62-23171b517735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:32.666198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394d47-cfa6-4ad2-ac62-23171b517735 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.666485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394d47-cfa6-4ad2-ac62-23171b517735 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.666863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394d47-cfa6-4ad2-ac62-23171b517735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.667603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25394d47-cfa6-4ad2-ac62-23171b517735 None admin] RBAC: Adding query filter params (role.id=8a7ad38a846e4411ac1dcc42523f6085, user.id=3a45e5c8c2bd4494b00aca4ec3e731d4, scope.system=all) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:32.667913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25394d47-cfa6-4ad2-ac62-23171b517735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:32.669451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25394d47-cfa6-4ad2-ac62-23171b517735 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:32.682568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 176/343] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:32.683423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0dfe7-3876-4dc8-a940-6be96057eabe None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:32.698853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 168/344] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Aug 8 00:15:32 2022] GET /identity/v3/role_assignments?user.id=3a45e5c8c2bd4494b00aca4ec3e731d4&scope.system=all&role.id=8a7ad38a846e4411ac1dcc42523f6085 => generated 510 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:32.700118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e370a-f831-47be-90ce-a785709fee8d None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.700405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e370a-f831-47be-90ce-a785709fee8d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.700683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e370a-f831-47be-90ce-a785709fee8d None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.701907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 169/345] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:32.716581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306953-7874-4066-8404-3162a8063df5 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.716889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306953-7874-4066-8404-3162a8063df5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.717142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306953-7874-4066-8404-3162a8063df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.748011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-11306953-7874-4066-8404-3162a8063df5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:32.749236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-11306953-7874-4066-8404-3162a8063df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:32.758628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:32.865614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0dfe7-3876-4dc8-a940-6be96057eabe None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:32.906181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 170/346] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:32.907066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306953-7874-4066-8404-3162a8063df5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:32.931079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:32.942798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1131-9110-4c7b-ae35-088d3fe46746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:32.943452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1131-9110-4c7b-ae35-088d3fe46746 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:32.943729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1131-9110-4c7b-ae35-088d3fe46746 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:32.943991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1131-9110-4c7b-ae35-088d3fe46746 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:32.967087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff1131-9110-4c7b-ae35-088d3fe46746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-6dff1131-9110-4c7b-ae35-088d3fe46746 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:32.971903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:32.975369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:32.977451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 177/347] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:32.979122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1131-9110-4c7b-ae35-088d3fe46746 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:33.032315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306953-7874-4066-8404-3162a8063df5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.072423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc13b9-f3c9-4324-9d9e-5f8c7af2fb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.073074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc13b9-f3c9-4324-9d9e-5f8c7af2fb9e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.073356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc13b9-f3c9-4324-9d9e-5f8c7af2fb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.073628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc13b9-f3c9-4324-9d9e-5f8c7af2fb9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.085257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc13b9-f3c9-4324-9d9e-5f8c7af2fb9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-36fc13b9-f3c9-4324-9d9e-5f8c7af2fb9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:33.090054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:33.093582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 171/348] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:33.097187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc13b9-f3c9-4324-9d9e-5f8c7af2fb9e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:33.104125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:33.115955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1131-9110-4c7b-ae35-088d3fe46746 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.165073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47107018-6481-4d04-87c4-bd1c13e769f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.165832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47107018-6481-4d04-87c4-bd1c13e769f3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.166150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47107018-6481-4d04-87c4-bd1c13e769f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.166423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47107018-6481-4d04-87c4-bd1c13e769f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.178176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:33.187232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47107018-6481-4d04-87c4-bd1c13e769f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-47107018-6481-4d04-87c4-bd1c13e769f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:33.192321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:33.194439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 178/349] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:33.196538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47107018-6481-4d04-87c4-bd1c13e769f3 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:33.204800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc13b9-f3c9-4324-9d9e-5f8c7af2fb9e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.242680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.243383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.243610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.243825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.244602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:33.244909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:33.246439 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:33.256187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 172/350] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:33.257103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:33.308394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47107018-6481-4d04-87c4-bd1c13e769f3 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.345604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.346241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.346544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.346787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.347444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:33.347872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:33.349333 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:33.358150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 179/351] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:33.362956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:33.369645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a986-8a73-4a6e-974f-7cb66ce98a4f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.381532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:33.408886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.409497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.409779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.410605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.411440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] RBAC: Adding query filter params (name=member) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:33.411750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:33.413134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:33.419954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:33.424565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 173/352] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:33.426382 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:33.475121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503fb03-2160-4f1b-b4c9-199bbd6ffee0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.511572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5747-0329-4eee-8d4c-1801dfa6053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.512175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5747-0329-4eee-8d4c-1801dfa6053c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.512452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5747-0329-4eee-8d4c-1801dfa6053c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.512726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5747-0329-4eee-8d4c-1801dfa6053c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.538192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ec1f1-af6e-4577-aa80-429fc1434580 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.578899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c6994-1b4b-44a7-9d0a-a35716a488e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.579518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c6994-1b4b-44a7-9d0a-a35716a488e9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.579805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c6994-1b4b-44a7-9d0a-a35716a488e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.580076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c6994-1b4b-44a7-9d0a-a35716a488e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.598777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a5747-0329-4eee-8d4c-1801dfa6053c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:33.600773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a5747-0329-4eee-8d4c-1801dfa6053c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:33.618475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:33.669996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:33.674295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c6994-1b4b-44a7-9d0a-a35716a488e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:33.675908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c6994-1b4b-44a7-9d0a-a35716a488e9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:33.736398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 180/353] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:33.737397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5747-0329-4eee-8d4c-1801dfa6053c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:33.797898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 174/354] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:33.799101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1bcc-b0ee-42ca-99af-61b0cffa084e None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.799491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1bcc-b0ee-42ca-99af-61b0cffa084e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.799869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1bcc-b0ee-42ca-99af-61b0cffa084e None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.802085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 175/355] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:33.802895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e1bcc-b0ee-42ca-99af-61b0cffa084e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:33.885362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5747-0329-4eee-8d4c-1801dfa6053c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.901676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:33.931739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df849-f282-4630-bdb2-a74e4f61b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.932280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df849-f282-4630-bdb2-a74e4f61b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.932560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df849-f282-4630-bdb2-a74e4f61b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.932833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df849-f282-4630-bdb2-a74e4f61b2f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.938436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:33.943922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e1bcc-b0ee-42ca-99af-61b0cffa084e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:33.989428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea543e-312b-4647-a0bf-a5ba1b305795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:33.990083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea543e-312b-4647-a0bf-a5ba1b305795 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:33.990387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea543e-312b-4647-a0bf-a5ba1b305795 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:33.990664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea543e-312b-4647-a0bf-a5ba1b305795 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:33.991803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea543e-312b-4647-a0bf-a5ba1b305795 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:33.993250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea543e-312b-4647-a0bf-a5ba1b305795 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:33.995053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 176/356] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:33 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:33.998995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea543e-312b-4647-a0bf-a5ba1b305795 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.016732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43df849-f282-4630-bdb2-a74e4f61b2f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:34.018233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43df849-f282-4630-bdb2-a74e4f61b2f4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:34.138870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea543e-312b-4647-a0bf-a5ba1b305795 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:34.140753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 181/357] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:34.142225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a958-9705-4db0-8601-b6c2570359b1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.142524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a958-9705-4db0-8601-b6c2570359b1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.142798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a958-9705-4db0-8601-b6c2570359b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.161116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-efa2a958-9705-4db0-8601-b6c2570359b1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:34.162722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-efa2a958-9705-4db0-8601-b6c2570359b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:34.172258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:34.180350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b49cb-1626-4c71-bec0-9e43f0014e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:34.180982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b49cb-1626-4c71-bec0-9e43f0014e66 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.181259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b49cb-1626-4c71-bec0-9e43f0014e66 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.181527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b49cb-1626-4c71-bec0-9e43f0014e66 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.182757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b49cb-1626-4c71-bec0-9e43f0014e66 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:34.184154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b49cb-1626-4c71-bec0-9e43f0014e66 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:34.185769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 177/358] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:33 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:34.190976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b49cb-1626-4c71-bec0-9e43f0014e66 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.231562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:34.243032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 182/359] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:34.244298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb789b-6a03-4040-97e0-b8edee71cb95 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.244582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb789b-6a03-4040-97e0-b8edee71cb95 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.244851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb789b-6a03-4040-97e0-b8edee71cb95 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.246260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 183/360] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:34.246800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb789b-6a03-4040-97e0-b8edee71cb95 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.306401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b49cb-1626-4c71-bec0-9e43f0014e66 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:34.348281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572ce65-d841-444b-93fb-c568fd63f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:34.349155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572ce65-d841-444b-93fb-c568fd63f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.349612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572ce65-d841-444b-93fb-c568fd63f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.350044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572ce65-d841-444b-93fb-c568fd63f6a6 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.356327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572ce65-d841-444b-93fb-c568fd63f6a6 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:34.358465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572ce65-d841-444b-93fb-c568fd63f6a6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:34.360107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 178/361] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:34.360881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572ce65-d841-444b-93fb-c568fd63f6a6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.377076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb789b-6a03-4040-97e0-b8edee71cb95 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:34.421259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dc8b7-f627-489e-a786-6cdcfc898223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:34.421899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc8b7-f627-489e-a786-6cdcfc898223 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.422218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc8b7-f627-489e-a786-6cdcfc898223 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.422481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc8b7-f627-489e-a786-6cdcfc898223 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.425404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dc8b7-f627-489e-a786-6cdcfc898223 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:34.426963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dc8b7-f627-489e-a786-6cdcfc898223 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:34.428627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 184/362] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:34.429770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceabee-a0d4-4f79-b9df-ac75ceb75db3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.430031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceabee-a0d4-4f79-b9df-ac75ceb75db3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.430350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceabee-a0d4-4f79-b9df-ac75ceb75db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.450053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d9ceabee-a0d4-4f79-b9df-ac75ceb75db3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:34.451244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d9ceabee-a0d4-4f79-b9df-ac75ceb75db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:34.461082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:34.480311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:34.484789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572ce65-d841-444b-93fb-c568fd63f6a6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:34.529976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c70a-10c6-4df1-9ed5-1821db5020cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:34.530696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c70a-10c6-4df1-9ed5-1821db5020cf None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.530964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c70a-10c6-4df1-9ed5-1821db5020cf None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.531780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c70a-10c6-4df1-9ed5-1821db5020cf None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.532339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995c70a-10c6-4df1-9ed5-1821db5020cf None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:34.533777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995c70a-10c6-4df1-9ed5-1821db5020cf None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:34.536851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 179/363] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:34.536851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c70a-10c6-4df1-9ed5-1821db5020cf None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.540257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 185/364] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:34.540474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceabee-a0d4-4f79-b9df-ac75ceb75db3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.656661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c70a-10c6-4df1-9ed5-1821db5020cf None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:34.656982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceabee-a0d4-4f79-b9df-ac75ceb75db3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:34.697833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a6c7-2465-425a-813b-0fe9dc3b3ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:34.698503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a6c7-2465-425a-813b-0fe9dc3b3ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.698786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a6c7-2465-425a-813b-0fe9dc3b3ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.699045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a6c7-2465-425a-813b-0fe9dc3b3ce8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.699923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:34.700586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.700991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.701272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.702003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] RBAC: Adding query filter params (group.id=9c86b9fc045a464aadb49649304057b7, role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:34.702396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:34.703815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:34.711919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0a6c7-2465-425a-813b-0fe9dc3b3ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:34.712081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 186/365] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/role_assignments?group.id=9c86b9fc045a464aadb49649304057b7&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=45f0e969ef594665877c4596781ce6aa => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:34.712745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-94f0a6c7-2465-425a-813b-0fe9dc3b3ce8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:34.720408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:34.721402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:34.723207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:34.724158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 180/366] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:34.725050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:34.726208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a6c7-2465-425a-813b-0fe9dc3b3ce8 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.772272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:34.859924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0484-4d95-40c3-a122-682cd95b91ed None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:34.871447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a6c7-2465-425a-813b-0fe9dc3b3ce8 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:34.907312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c704-4f43-4849-8b2a-7f5e032073a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:34.907954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c704-4f43-4849-8b2a-7f5e032073a7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.908348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c704-4f43-4849-8b2a-7f5e032073a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.908629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c704-4f43-4849-8b2a-7f5e032073a7 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.909804 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c704-4f43-4849-8b2a-7f5e032073a7 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:34.912039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c704-4f43-4849-8b2a-7f5e032073a7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:34.914086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 187/367] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:34.914878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c704-4f43-4849-8b2a-7f5e032073a7 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:34.919717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:34.920339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:34.920621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:34.920892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:34.921624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] RBAC: Adding query filter params (group.id=9c86b9fc045a464aadb49649304057b7, role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:34.921927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:34.923400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:34.929395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 181/368] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/role_assignments?group.id=9c86b9fc045a464aadb49649304057b7&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:34.930118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:35.039950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:35.058740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:35.072114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948353c-33d7-4d7e-a288-e00e7db1dc31 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:35.075485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c704-4f43-4849-8b2a-7f5e032073a7 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:35.116838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:35.117460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:35.117738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:35.118011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:35.118790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:35.118926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cb202-26bd-4248-abbc-a62e225b60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:35.119090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:35.119828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cb202-26bd-4248-abbc-a62e225b60a9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:35.120270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cb202-26bd-4248-abbc-a62e225b60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:35.120590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:35.120891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cb202-26bd-4248-abbc-a62e225b60a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:35.131104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 182/369] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:35.132272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:35.133821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cb202-26bd-4248-abbc-a62e225b60a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-540cb202-26bd-4248-abbc-a62e225b60a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:35.139466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:35.140514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:35.141454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:35.143649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 188/370] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:35.145577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cb202-26bd-4248-abbc-a62e225b60a9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:35.260753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cb202-26bd-4248-abbc-a62e225b60a9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:35.283087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7465-479b-47b1-af41-b821b1ffa628 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:35.304416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f74b6b-51f1-4be9-baf3-b87c961d65d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:35.305060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74b6b-51f1-4be9-baf3-b87c961d65d3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:35.305342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74b6b-51f1-4be9-baf3-b87c961d65d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:35.305609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74b6b-51f1-4be9-baf3-b87c961d65d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:35.309397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:35.327202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:35.328315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:35.329186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:35.329631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:35.330529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] RBAC: Adding query filter params (group.id=9c86b9fc045a464aadb49649304057b7, role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:35.331023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:35.333573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:35.342546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 183/371] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:35 2022] GET /identity/v3/role_assignments?group.id=9c86b9fc045a464aadb49649304057b7&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:35.343697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:35.376779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:35.410495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f74b6b-51f1-4be9-baf3-b87c961d65d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:35.412146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f74b6b-51f1-4be9-baf3-b87c961d65d3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:35.511121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c7e-44b2-4d56-83d3-c12f15a393f3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:35.569107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:35.570098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:35.571715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:35.572143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:35.572973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:35.575079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:35.576964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:35.594127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 184/372] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:35.601914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 189/373] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:35.607402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:35.607551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f74b6b-51f1-4be9-baf3-b87c961d65d3 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:35.669049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:35.710765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:35.732511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dea4dd-8003-4b40-82ee-689003adfd93 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:35.770895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d2acd-1824-4f06-935f-9ecf27011b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:35.771854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2acd-1824-4f06-935f-9ecf27011b51 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:35.772142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2acd-1824-4f06-935f-9ecf27011b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:35.772412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2acd-1824-4f06-935f-9ecf27011b51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:35.849015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d2acd-1824-4f06-935f-9ecf27011b51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:35.852268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d2acd-1824-4f06-935f-9ecf27011b51 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:35.880558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f74b6b-51f1-4be9-baf3-b87c961d65d3 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:35.942439 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:35.962778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad6b7-504b-4e61-a6ad-4bf5cf38cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:35.963432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad6b7-504b-4e61-a6ad-4bf5cf38cf02 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:35.963805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad6b7-504b-4e61-a6ad-4bf5cf38cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:35.964075 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad6b7-504b-4e61-a6ad-4bf5cf38cf02 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:35.965116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 185/374] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:35.965411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aad6b7-504b-4e61-a6ad-4bf5cf38cf02 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:35.966880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aad6b7-504b-4e61-a6ad-4bf5cf38cf02 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:35.968662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 190/375] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:35 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:35.973884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d2acd-1824-4f06-935f-9ecf27011b51 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:35.987226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad6b7-504b-4e61-a6ad-4bf5cf38cf02 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:36.087322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d2acd-1824-4f06-935f-9ecf27011b51 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:36.118397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad6b7-504b-4e61-a6ad-4bf5cf38cf02 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:36.120464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:36.132373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83de43-2124-4d0f-911f-415831d810a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:36.134518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83de43-2124-4d0f-911f-415831d810a9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:36.134816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83de43-2124-4d0f-911f-415831d810a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:36.135101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83de43-2124-4d0f-911f-415831d810a9 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:36.136423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83de43-2124-4d0f-911f-415831d810a9 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:36.138038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83de43-2124-4d0f-911f-415831d810a9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:36.140163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 186/376] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:35 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:36.146157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83de43-2124-4d0f-911f-415831d810a9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:36.177045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e4716-d79c-4176-9415-c07056afdc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:36.177734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4716-d79c-4176-9415-c07056afdc57 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:36.178017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4716-d79c-4176-9415-c07056afdc57 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:36.178318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4716-d79c-4176-9415-c07056afdc57 None admin] PATH_INFO: `/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:36.179654 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e4716-d79c-4176-9415-c07056afdc57 None admin] RBAC: Authorizing `identity:get_project(project_id=c2bbcd4a1f6a42dcb7f98d6bb69581ae)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:36.181089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e4716-d79c-4176-9415-c07056afdc57 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:36.186093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 191/377] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:35 2022] GET /identity/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:36.190864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e4716-d79c-4176-9415-c07056afdc57 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:36.244924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:36.346369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e4716-d79c-4176-9415-c07056afdc57 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:36.347642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83de43-2124-4d0f-911f-415831d810a9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:36.392098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:36.392631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:36.392910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:36.393182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:36.393907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] RBAC: Adding query filter params (group.id=9c86b9fc045a464aadb49649304057b7, role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:36.394595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:36.397378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:36.405183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 187/378] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:36 2022] GET /identity/v3/role_assignments?group.id=9c86b9fc045a464aadb49649304057b7&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=45f0e969ef594665877c4596781ce6aa => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:36.420151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488bf1-b12c-4928-b108-2c625b87e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:36.421081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488bf1-b12c-4928-b108-2c625b87e503 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:36.421507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488bf1-b12c-4928-b108-2c625b87e503 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:36.421923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488bf1-b12c-4928-b108-2c625b87e503 None admin] PATH_INFO: `/v3/groups/79efb0a47a6f484ea1001e39b215d882` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:36.437079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c488bf1-b12c-4928-b108-2c625b87e503 None admin] RBAC: Authorizing `identity:get_group(group_id=79efb0a47a6f484ea1001e39b215d882)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:36.438810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c488bf1-b12c-4928-b108-2c625b87e503 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:36.440659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 192/379] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:36 2022] GET /identity/v3/groups/79efb0a47a6f484ea1001e39b215d882 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:36.447262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:36.586491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3005a-2601-41a7-afdc-8c498eb99676 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:36.601996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:36.641120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2436e-9ce5-4ec7-842d-b25d2b875120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:36.641735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2436e-9ce5-4ec7-842d-b25d2b875120 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:36.642015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2436e-9ce5-4ec7-842d-b25d2b875120 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:36.642371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2436e-9ce5-4ec7-842d-b25d2b875120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:36.643051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2436e-9ce5-4ec7-842d-b25d2b875120 None admin] RBAC: Adding query filter params (group.id=79efb0a47a6f484ea1001e39b215d882, role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=c2bbcd4a1f6a42dcb7f98d6bb69581ae) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:36.643364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2436e-9ce5-4ec7-842d-b25d2b875120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:36.645744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2436e-9ce5-4ec7-842d-b25d2b875120 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:36.652924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 188/380] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:36 2022] GET /identity/v3/role_assignments?group.id=79efb0a47a6f484ea1001e39b215d882&scope.project.id=c2bbcd4a1f6a42dcb7f98d6bb69581ae&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:37.250410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73d69-a7c6-43a2-816c-68ddf8074201 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:37.250954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73d69-a7c6-43a2-816c-68ddf8074201 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:37.250954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73d69-a7c6-43a2-816c-68ddf8074201 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:37.252554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 193/381] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:37.258627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b274f7-32e4-40c6-a56d-a5255c585285 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:37.259014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b274f7-32e4-40c6-a56d-a5255c585285 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:37.259212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b274f7-32e4-40c6-a56d-a5255c585285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:37.287020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-88b274f7-32e4-40c6-a56d-a5255c585285 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:37.288215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-88b274f7-32e4-40c6-a56d-a5255c585285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:37.381155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 189/382] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:37.415299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73d69-a7c6-43a2-816c-68ddf8074201 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:37.464347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:37.543816 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73d69-a7c6-43a2-816c-68ddf8074201 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:37.587649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb655-af5d-4a0a-9d8c-e302db7586d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:37.588281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb655-af5d-4a0a-9d8c-e302db7586d6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:37.588559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb655-af5d-4a0a-9d8c-e302db7586d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:37.588830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb655-af5d-4a0a-9d8c-e302db7586d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:37.603194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffb655-af5d-4a0a-9d8c-e302db7586d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-d2ffb655-af5d-4a0a-9d8c-e302db7586d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:37.608342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:37.609448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:37.610320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 194/383] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:37.619166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b274f7-32e4-40c6-a56d-a5255c585285 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:37.679906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d7932-8892-40c4-9af9-e8c924d7c7cd None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:37.680189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d7932-8892-40c4-9af9-e8c924d7c7cd None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:37.680462 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d7932-8892-40c4-9af9-e8c924d7c7cd None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:37.682048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 195/384] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:37.699320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb672b2-94a5-43a9-a4c8-a1fe3435af49 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:37.699600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb672b2-94a5-43a9-a4c8-a1fe3435af49 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:37.699881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb672b2-94a5-43a9-a4c8-a1fe3435af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:37.747061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9fb672b2-94a5-43a9-a4c8-a1fe3435af49 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:37.748259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9fb672b2-94a5-43a9-a4c8-a1fe3435af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:37.752585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b274f7-32e4-40c6-a56d-a5255c585285 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:37.760459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:37.795200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:37.795725 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:37.796005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:37.796273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:37.796935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:37.797238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:37.799278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:37.818386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 190/385] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:37.826913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:37.880074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 196/386] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:37.907147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb672b2-94a5-43a9-a4c8-a1fe3435af49 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:37.969375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b78c3-c229-4b75-9abb-3bf41eacdf84 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:37.970587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:38.007208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb4da-1fef-4607-ba2f-aa0cfc55a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.008298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb4da-1fef-4607-ba2f-aa0cfc55a942 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.008807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb4da-1fef-4607-ba2f-aa0cfc55a942 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.009313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb4da-1fef-4607-ba2f-aa0cfc55a942 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.010689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb4da-1fef-4607-ba2f-aa0cfc55a942 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:38.012412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb4da-1fef-4607-ba2f-aa0cfc55a942 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:38.014522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 191/387] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:37 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:38.020989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb4da-1fef-4607-ba2f-aa0cfc55a942 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:38.061944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:38.127754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb672b2-94a5-43a9-a4c8-a1fe3435af49 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.134446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb4da-1fef-4607-ba2f-aa0cfc55a942 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.171655 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c3db0-015a-4259-b3b5-c824786fabd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.172659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3db0-015a-4259-b3b5-c824786fabd0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.173166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3db0-015a-4259-b3b5-c824786fabd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.173696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3db0-015a-4259-b3b5-c824786fabd0 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.175090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c3db0-015a-4259-b3b5-c824786fabd0 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:38.175407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac436c7-340e-4447-81e1-982738792438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.176525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac436c7-340e-4447-81e1-982738792438 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.176805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac436c7-340e-4447-81e1-982738792438 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.177082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac436c7-340e-4447-81e1-982738792438 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.178213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c3db0-015a-4259-b3b5-c824786fabd0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:38.180102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 192/388] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:38 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:38.185985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722cf9-d7f3-4f66-b69d-78663913eafa None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.186743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722cf9-d7f3-4f66-b69d-78663913eafa None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.187181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722cf9-d7f3-4f66-b69d-78663913eafa None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.187942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac436c7-340e-4447-81e1-982738792438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:38.188958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 193/389] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:38.189788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90722cf9-d7f3-4f66-b69d-78663913eafa None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-cac436c7-340e-4447-81e1-982738792438 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:38.198766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:38.199970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:38.200770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 197/390] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:38.206043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922562a-e713-48c1-94cc-134668b3ab09 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.206043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922562a-e713-48c1-94cc-134668b3ab09 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.206043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922562a-e713-48c1-94cc-134668b3ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.220937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4922562a-e713-48c1-94cc-134668b3ab09 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:38.222141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4922562a-e713-48c1-94cc-134668b3ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:38.291614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 198/391] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:38.297523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922562a-e713-48c1-94cc-134668b3ab09 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:38.316492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90722cf9-d7f3-4f66-b69d-78663913eafa None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.320257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:38.324679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:38.360538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b240-a1d8-434d-8724-739fb41bfdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.361302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b240-a1d8-434d-8724-739fb41bfdff None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.361586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b240-a1d8-434d-8724-739fb41bfdff None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.361863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b240-a1d8-434d-8724-739fb41bfdff None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/groups/9c86b9fc045a464aadb49649304057b7/roles/45f0e969ef594665877c4596781ce6aa` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.364785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9b240-a1d8-434d-8724-739fb41bfdff None admin] RBAC: Authorizing `identity:create_grant(project_id=ea16686f0e7343b88fa1696b8b1715ed, group_id=9c86b9fc045a464aadb49649304057b7, role_id=45f0e969ef594665877c4596781ce6aa)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:38.366364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9b240-a1d8-434d-8724-739fb41bfdff None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:38.390093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 194/392] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 00:15:38 2022] PUT /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/groups/9c86b9fc045a464aadb49649304057b7/roles/45f0e969ef594665877c4596781ce6aa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:38.390093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b240-a1d8-434d-8724-739fb41bfdff None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:38.494413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922562a-e713-48c1-94cc-134668b3ab09 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.559874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b240-a1d8-434d-8724-739fb41bfdff None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.567218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.567775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.568054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.568325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.568983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:38.569281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:38.570669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:38.582301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 199/393] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:38.587874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:38.601855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c333-3863-4a0f-9e6d-db033e096e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.602659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c333-3863-4a0f-9e6d-db033e096e9d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.602943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c333-3863-4a0f-9e6d-db033e096e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.603217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c333-3863-4a0f-9e6d-db033e096e9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.618225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c333-3863-4a0f-9e6d-db033e096e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7be4c333-3863-4a0f-9e6d-db033e096e9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:38.625642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:38.626751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:38.627729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 195/394] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:38.634672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c333-3863-4a0f-9e6d-db033e096e9d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:38.680706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:38.683344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:38.709673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf507d3f-0ee4-4b44-8d57-40b5d6f1909b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.766884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c333-3863-4a0f-9e6d-db033e096e9d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.789990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db00f39-301b-406e-911e-eb3884b9138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.790761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db00f39-301b-406e-911e-eb3884b9138a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.791044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db00f39-301b-406e-911e-eb3884b9138a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.791315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db00f39-301b-406e-911e-eb3884b9138a None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.793794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db00f39-301b-406e-911e-eb3884b9138a None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:38.795269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db00f39-301b-406e-911e-eb3884b9138a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:38.797567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 200/395] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:38 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:38.804509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db00f39-301b-406e-911e-eb3884b9138a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:38.809171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.809790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.810094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.810371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.811094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] RBAC: Adding query filter params (name=member) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:38.811399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:38.813159 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:38.824599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 196/396] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:38.831076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:38.949690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a7842-ba36-47b6-9082-28a5219e0053 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.986988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df686832-79ea-4962-bdba-5fc97df49841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:38.987626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df686832-79ea-4962-bdba-5fc97df49841 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:38.988433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df686832-79ea-4962-bdba-5fc97df49841 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:38.988697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df686832-79ea-4962-bdba-5fc97df49841 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:38.990093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df686832-79ea-4962-bdba-5fc97df49841 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:38.991511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df686832-79ea-4962-bdba-5fc97df49841 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:38.993631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 197/397] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:38 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:38.994366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:38.996909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db00f39-301b-406e-911e-eb3884b9138a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:38.999293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df686832-79ea-4962-bdba-5fc97df49841 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.033589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe918e-56e6-4dae-ac3c-ddc8bb46024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:39.034644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe918e-56e6-4dae-ac3c-ddc8bb46024f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.035169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe918e-56e6-4dae-ac3c-ddc8bb46024f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.035647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe918e-56e6-4dae-ac3c-ddc8bb46024f None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.036970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe918e-56e6-4dae-ac3c-ddc8bb46024f None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:39.038652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe918e-56e6-4dae-ac3c-ddc8bb46024f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:39.040556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 201/398] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:38 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:39.046957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe918e-56e6-4dae-ac3c-ddc8bb46024f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.070901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:39.111143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df686832-79ea-4962-bdba-5fc97df49841 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:39.147807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c84807-4f46-4bea-8690-76bf9a635cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:39.148838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84807-4f46-4bea-8690-76bf9a635cdb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.149224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84807-4f46-4bea-8690-76bf9a635cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.149564 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84807-4f46-4bea-8690-76bf9a635cdb None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.150843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c84807-4f46-4bea-8690-76bf9a635cdb None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:39.152376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c84807-4f46-4bea-8690-76bf9a635cdb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:39.158615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 198/399] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:38 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:39.158615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b89f-3809-4d4e-bf45-c21dd7c0a7b2 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.158615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b89f-3809-4d4e-bf45-c21dd7c0a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.158615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b89f-3809-4d4e-bf45-c21dd7c0a7b2 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.158615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 199/400] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:39.158615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b08-78c2-4fb5-b91c-59c88ee101ec None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.159063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b08-78c2-4fb5-b91c-59c88ee101ec None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.159063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b08-78c2-4fb5-b91c-59c88ee101ec None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.161052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 200/401] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:39.161843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66b08-78c2-4fb5-b91c-59c88ee101ec None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.173604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe918e-56e6-4dae-ac3c-ddc8bb46024f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:39.193352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:39.208879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acc1fd-96fd-4354-9364-a0044180d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:39.209618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acc1fd-96fd-4354-9364-a0044180d352 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.209968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acc1fd-96fd-4354-9364-a0044180d352 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.210291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acc1fd-96fd-4354-9364-a0044180d352 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/groups/9c86b9fc045a464aadb49649304057b7/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.212158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acc1fd-96fd-4354-9364-a0044180d352 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea16686f0e7343b88fa1696b8b1715ed, group_id=9c86b9fc045a464aadb49649304057b7, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:39.213567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acc1fd-96fd-4354-9364-a0044180d352 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:39.227014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 202/402] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 00:15:39 2022] PUT /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed/groups/9c86b9fc045a464aadb49649304057b7/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:39.228311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3861db-eda3-4072-aa41-b4230bb6a5cd None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.228595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3861db-eda3-4072-aa41-b4230bb6a5cd None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.228865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3861db-eda3-4072-aa41-b4230bb6a5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.247620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-7e3861db-eda3-4072-aa41-b4230bb6a5cd None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:39.248894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7e3861db-eda3-4072-aa41-b4230bb6a5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:39.305975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66b08-78c2-4fb5-b91c-59c88ee101ec None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:39.333057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 203/403] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:39.333057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d984e7-3f88-4c85-849a-38ead7b52486 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.333057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d984e7-3f88-4c85-849a-38ead7b52486 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.333057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d984e7-3f88-4c85-849a-38ead7b52486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.339265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:39.351419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-50d984e7-3f88-4c85-849a-38ead7b52486 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:39.352634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-50d984e7-3f88-4c85-849a-38ead7b52486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:39.376601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78051a4a-9bd3-4d47-ab4c-982d545d82fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:39.378086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78051a4a-9bd3-4d47-ab4c-982d545d82fb None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.379187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78051a4a-9bd3-4d47-ab4c-982d545d82fb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.379678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78051a4a-9bd3-4d47-ab4c-982d545d82fb None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/groups/9c86b9fc045a464aadb49649304057b7/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.382190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78051a4a-9bd3-4d47-ab4c-982d545d82fb None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4f3487ce94cc4b6371ef214d4c512, group_id=9c86b9fc045a464aadb49649304057b7, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:39.383954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78051a4a-9bd3-4d47-ab4c-982d545d82fb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:39.401831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 201/404] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 00:15:39 2022] PUT /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/groups/9c86b9fc045a464aadb49649304057b7/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:39.403140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78051a4a-9bd3-4d47-ab4c-982d545d82fb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.442226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 204/405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:39.463997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d984e7-3f88-4c85-849a-38ead7b52486 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.526486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:39.529882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78051a4a-9bd3-4d47-ab4c-982d545d82fb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:39.571822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2a771-6928-4156-8489-c3663468067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:39.572614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2a771-6928-4156-8489-c3663468067b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.573026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2a771-6928-4156-8489-c3663468067b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.573302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2a771-6928-4156-8489-c3663468067b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.585731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2a771-6928-4156-8489-c3663468067b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7aa2a771-6928-4156-8489-c3663468067b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:39.591346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:39.592241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:39.593082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 202/406] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:39.600844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2a771-6928-4156-8489-c3663468067b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.636686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d984e7-3f88-4c85-849a-38ead7b52486 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:39.672461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:39.680237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f85d-e6e5-4f83-a591-bcb65bb7a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:39.681014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f85d-e6e5-4f83-a591-bcb65bb7a46c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.681422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f85d-e6e5-4f83-a591-bcb65bb7a46c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.681859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f85d-e6e5-4f83-a591-bcb65bb7a46c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.695648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8f85d-e6e5-4f83-a591-bcb65bb7a46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-afc8f85d-e6e5-4f83-a591-bcb65bb7a46c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:39.701971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:39.702951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:39.703919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:39.706656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 205/407] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:39.711302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f85d-e6e5-4f83-a591-bcb65bb7a46c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.732964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2a771-6928-4156-8489-c3663468067b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:39.795737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:39.796349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.796687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.796961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.797688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:39.797997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:39.801527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:39.818086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 203/408] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:39.824151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.828730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:39.880458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f85d-e6e5-4f83-a591-bcb65bb7a46c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:39.918999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:39.919526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:39.919804 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:39.920071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:39.920735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:39.921036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:39.922433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:39.931832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 206/409] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:39.937224 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:39.986798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e7122-001b-4fed-9436-b399ea26dc5c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:39.994193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:40.029075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba29811-deba-493e-96b6-dbeec395058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:40.029705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba29811-deba-493e-96b6-dbeec395058e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:40.029983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba29811-deba-493e-96b6-dbeec395058e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:40.030289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba29811-deba-493e-96b6-dbeec395058e None admin] PATH_INFO: `/v3/groups/79efb0a47a6f484ea1001e39b215d882` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:40.032234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba29811-deba-493e-96b6-dbeec395058e None admin] RBAC: Authorizing `identity:get_group(group_id=79efb0a47a6f484ea1001e39b215d882)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:40.033706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba29811-deba-493e-96b6-dbeec395058e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:40.035973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 204/410] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:39 2022] GET /identity/v3/groups/79efb0a47a6f484ea1001e39b215d882 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:40.041226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba29811-deba-493e-96b6-dbeec395058e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:40.093203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72045fb1-c915-4ad2-a320-b8344f7f8a11 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:40.130751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f493e1-df01-4509-8d6a-b73643f9cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:40.131395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f493e1-df01-4509-8d6a-b73643f9cd36 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:40.131737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f493e1-df01-4509-8d6a-b73643f9cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:40.132014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f493e1-df01-4509-8d6a-b73643f9cd36 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:40.133240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f493e1-df01-4509-8d6a-b73643f9cd36 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:40.134863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f493e1-df01-4509-8d6a-b73643f9cd36 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:40.136972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 207/411] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:39 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:40.141856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f493e1-df01-4509-8d6a-b73643f9cd36 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:40.178863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:40.191609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba29811-deba-493e-96b6-dbeec395058e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:40.258812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3744f3-95b3-48db-b545-2aabe588a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:40.261443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3744f3-95b3-48db-b545-2aabe588a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:40.261909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3744f3-95b3-48db-b545-2aabe588a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:40.262991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3744f3-95b3-48db-b545-2aabe588a4a0 None admin] PATH_INFO: `/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:40.264931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3744f3-95b3-48db-b545-2aabe588a4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c2bbcd4a1f6a42dcb7f98d6bb69581ae)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:40.267888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3744f3-95b3-48db-b545-2aabe588a4a0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:40.270173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 205/412] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:40 2022] GET /identity/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:40.277406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3744f3-95b3-48db-b545-2aabe588a4a0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:40.319214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f493e1-df01-4509-8d6a-b73643f9cd36 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:40.346890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:40.356016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717b90-a51d-49f1-a7d5-85d597b03b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:40.356984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717b90-a51d-49f1-a7d5-85d597b03b04 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:40.357475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717b90-a51d-49f1-a7d5-85d597b03b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:40.358010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717b90-a51d-49f1-a7d5-85d597b03b04 None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:40.359406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717b90-a51d-49f1-a7d5-85d597b03b04 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:40.361123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717b90-a51d-49f1-a7d5-85d597b03b04 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:40.363364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 208/413] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:40 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:40.368669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717b90-a51d-49f1-a7d5-85d597b03b04 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:40.441731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3744f3-95b3-48db-b545-2aabe588a4a0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:40.479552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db439a-e744-4732-90cc-677112202e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:40.480216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db439a-e744-4732-90cc-677112202e2b None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:40.480557 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db439a-e744-4732-90cc-677112202e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:40.480887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db439a-e744-4732-90cc-677112202e2b None admin] PATH_INFO: `/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae/groups/79efb0a47a6f484ea1001e39b215d882/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:40.483117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db439a-e744-4732-90cc-677112202e2b None admin] RBAC: Authorizing `identity:create_grant(project_id=c2bbcd4a1f6a42dcb7f98d6bb69581ae, group_id=79efb0a47a6f484ea1001e39b215d882, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:40.484565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db439a-e744-4732-90cc-677112202e2b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:40.489296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717b90-a51d-49f1-a7d5-85d597b03b04 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:40.498400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:40.504112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 206/414] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 00:15:40 2022] PUT /identity/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae/groups/79efb0a47a6f484ea1001e39b215d882/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:15:40.567867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55888-545e-4e39-a45f-5a4d12ea28bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:40.568613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55888-545e-4e39-a45f-5a4d12ea28bf None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:40.568896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55888-545e-4e39-a45f-5a4d12ea28bf None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:40.569172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55888-545e-4e39-a45f-5a4d12ea28bf None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/groups/9c86b9fc045a464aadb49649304057b7/roles/45f0e969ef594665877c4596781ce6aa` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:40.572588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55888-545e-4e39-a45f-5a4d12ea28bf None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4f3487ce94cc4b6371ef214d4c512, group_id=9c86b9fc045a464aadb49649304057b7, role_id=45f0e969ef594665877c4596781ce6aa)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:40.574097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55888-545e-4e39-a45f-5a4d12ea28bf None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:40.595594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 209/415] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Aug 8 00:15:40 2022] PUT /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512/groups/9c86b9fc045a464aadb49649304057b7/roles/45f0e969ef594665877c4596781ce6aa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:15:40.841416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e45eb-fd0c-44cb-881f-a1ca3dc87309 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:40.841781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e45eb-fd0c-44cb-881f-a1ca3dc87309 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:40.841981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e45eb-fd0c-44cb-881f-a1ca3dc87309 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:40.843550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 207/416] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:40.853101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086bdf-2932-4e21-ba83-f73f8aabba96 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:40.853101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086bdf-2932-4e21-ba83-f73f8aabba96 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:40.853101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086bdf-2932-4e21-ba83-f73f8aabba96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:40.881214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c3086bdf-2932-4e21-ba83-f73f8aabba96 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:40.882876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c3086bdf-2932-4e21-ba83-f73f8aabba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:40.936823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:40.963660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 210/417] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:40.986888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e45eb-fd0c-44cb-881f-a1ca3dc87309 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:41.128899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e45eb-fd0c-44cb-881f-a1ca3dc87309 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:41.178973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb2b5-edb4-4c51-90ce-8db0705c3fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:41.180071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb2b5-edb4-4c51-90ce-8db0705c3fae None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:41.180613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb2b5-edb4-4c51-90ce-8db0705c3fae None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:41.181091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb2b5-edb4-4c51-90ce-8db0705c3fae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:41.198639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9deb2b5-edb4-4c51-90ce-8db0705c3fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-f9deb2b5-edb4-4c51-90ce-8db0705c3fae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:41.203964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:41.204836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:41.205715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:41.208596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 208/418] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:41.215173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3086bdf-2932-4e21-ba83-f73f8aabba96 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:41.391732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3086bdf-2932-4e21-ba83-f73f8aabba96 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:41.443340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:41.443945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:41.444226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:41.444500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:41.445153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:41.445451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:41.446828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:41.461683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 211/419] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:41.467507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb2b5-edb4-4c51-90ce-8db0705c3fae None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:41.544144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:41.589850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb2b5-edb4-4c51-90ce-8db0705c3fae None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:41.633548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15815-2949-4961-9ef1-17e884ea6d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:41.634189 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15815-2949-4961-9ef1-17e884ea6d4e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:41.634470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15815-2949-4961-9ef1-17e884ea6d4e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:41.634741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15815-2949-4961-9ef1-17e884ea6d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:41.726810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15815-2949-4961-9ef1-17e884ea6d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:41.728327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15815-2949-4961-9ef1-17e884ea6d4e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:41.791797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:41.835768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 209/420] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:41.841606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:41.929934 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:42.006355 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f553-56c2-469b-a3fe-312742351f6b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:42.055121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141ae1f-3329-4b53-8eca-54bbe094b4e8 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.055443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141ae1f-3329-4b53-8eca-54bbe094b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.055774 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141ae1f-3329-4b53-8eca-54bbe094b4e8 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.056140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b86b6-f831-4025-8ed1-406ccd8588c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:42.056780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b86b6-f831-4025-8ed1-406ccd8588c8 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.057064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b86b6-f831-4025-8ed1-406ccd8588c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.057332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 210/421] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:42.057432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b86b6-f831-4025-8ed1-406ccd8588c8 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.059970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b86b6-f831-4025-8ed1-406ccd8588c8 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:42.061406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b86b6-f831-4025-8ed1-406ccd8588c8 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:42.062408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33097-6b76-453e-9499-b9eb712ee071 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.062693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33097-6b76-453e-9499-b9eb712ee071 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.062968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33097-6b76-453e-9499-b9eb712ee071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.063302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 212/422] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:41 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:42.074340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b86b6-f831-4025-8ed1-406ccd8588c8 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:42.087665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8dd33097-6b76-453e-9499-b9eb712ee071 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:42.089635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8dd33097-6b76-453e-9499-b9eb712ee071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:42.181893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 211/423] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:42.181893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cb3da-c9c6-4798-8f4b-768e80ae258f None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.181893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cb3da-c9c6-4798-8f4b-768e80ae258f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.181893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cb3da-c9c6-4798-8f4b-768e80ae258f None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.181893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 212/424] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:42.193149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85bc9-ecbf-4046-817d-1b1878a63d1e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.193149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85bc9-ecbf-4046-817d-1b1878a63d1e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.193149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85bc9-ecbf-4046-817d-1b1878a63d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.222844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-62e85bc9-ecbf-4046-817d-1b1878a63d1e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:42.224303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-62e85bc9-ecbf-4046-817d-1b1878a63d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:42.231653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b86b6-f831-4025-8ed1-406ccd8588c8 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:42.245764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:42.271634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f57b57-b6b4-4bd0-b023-3ab5973af143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:42.272329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f57b57-b6b4-4bd0-b023-3ab5973af143 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.272605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f57b57-b6b4-4bd0-b023-3ab5973af143 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.272947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f57b57-b6b4-4bd0-b023-3ab5973af143 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.274132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f57b57-b6b4-4bd0-b023-3ab5973af143 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:42.275634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f57b57-b6b4-4bd0-b023-3ab5973af143 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:42.277291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 213/425] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:42 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:42.282799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f57b57-b6b4-4bd0-b023-3ab5973af143 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:42.304809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 213/426] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:42.311304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85bc9-ecbf-4046-817d-1b1878a63d1e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:42.336950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:42.385754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f57b57-b6b4-4bd0-b023-3ab5973af143 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:42.420264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6ff1d-4d40-4e4e-8d50-49f974245030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:42.420878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ff1d-4d40-4e4e-8d50-49f974245030 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.421180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ff1d-4d40-4e4e-8d50-49f974245030 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.421541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ff1d-4d40-4e4e-8d50-49f974245030 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.432129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85bc9-ecbf-4046-817d-1b1878a63d1e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:42.432844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6ff1d-4d40-4e4e-8d50-49f974245030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-afa6ff1d-4d40-4e4e-8d50-49f974245030 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:42.438148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:42.439053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:42.439835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 214/427] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:42.440483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6ff1d-4d40-4e4e-8d50-49f974245030 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:42.473710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:42.475062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.475526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.476034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.477088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] RBAC: Adding query filter params (group.id=9c86b9fc045a464aadb49649304057b7, role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:42.477662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:42.479319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:42.485927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 214/428] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:42 2022] GET /identity/v3/role_assignments?group.id=9c86b9fc045a464aadb49649304057b7&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=45f0e969ef594665877c4596781ce6aa => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:42.487110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:42.490530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:42.576736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6ff1d-4d40-4e4e-8d50-49f974245030 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:42.629105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719e22a-d33a-4040-8585-b03d7e810d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:42.629751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e22a-d33a-4040-8585-b03d7e810d5f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.630029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e22a-d33a-4040-8585-b03d7e810d5f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.630327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e22a-d33a-4040-8585-b03d7e810d5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.659342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719e22a-d33a-4040-8585-b03d7e810d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-2719e22a-d33a-4040-8585-b03d7e810d5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:42.665058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:42.666003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 00:15:42.666826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:42.668736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 215/429] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:42.673591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719e22a-d33a-4040-8585-b03d7e810d5f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:42.677415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:42.697378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306eb31-8fc3-4516-a476-d30fda5ed3fb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:42.741184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:42.742682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.743233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.743724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.744825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:42.745661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:42.747785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:42.760115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 215/430] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:42.766208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:42.790782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:42.795639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719e22a-d33a-4040-8585-b03d7e810d5f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:42.844110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151f3a-5c08-46a2-bf29-9e0d78c6dd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:42.844794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151f3a-5c08-46a2-bf29-9e0d78c6dd6d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.845074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151f3a-5c08-46a2-bf29-9e0d78c6dd6d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.845346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151f3a-5c08-46a2-bf29-9e0d78c6dd6d None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.846003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9151f3a-5c08-46a2-bf29-9e0d78c6dd6d None admin] RBAC: Adding query filter params (name=member) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:42.846327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9151f3a-5c08-46a2-bf29-9e0d78c6dd6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:42.848415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9151f3a-5c08-46a2-bf29-9e0d78c6dd6d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:42.864439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 216/431] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:42.864439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef104-a3cb-4dba-9d11-c55f5c9cf062 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.864439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef104-a3cb-4dba-9d11-c55f5c9cf062 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.864439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef104-a3cb-4dba-9d11-c55f5c9cf062 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.864439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 217/432] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:42.864439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ef104-a3cb-4dba-9d11-c55f5c9cf062 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:42.902142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaa0cf-c2ec-42d1-8570-7c71ec4b8ff1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:42.943442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf55f0-90cf-4dad-8013-2687f51438c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:42.944033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf55f0-90cf-4dad-8013-2687f51438c2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:42.944674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf55f0-90cf-4dad-8013-2687f51438c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:42.944952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf55f0-90cf-4dad-8013-2687f51438c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:42.961858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:42.969509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ef104-a3cb-4dba-9d11-c55f5c9cf062 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.005329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0be30-c021-4467-b9be-544bd8623956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.005992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0be30-c021-4467-b9be-544bd8623956 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.006374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0be30-c021-4467-b9be-544bd8623956 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.006651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0be30-c021-4467-b9be-544bd8623956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.023221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf55f0-90cf-4dad-8013-2687f51438c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:43.024693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf55f0-90cf-4dad-8013-2687f51438c2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:43.037735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.080071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0be30-c021-4467-b9be-544bd8623956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:43.082055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0be30-c021-4467-b9be-544bd8623956 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:43.133515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 216/433] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:15:43.134869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80714d-76b5-4c6b-b078-fcd9aa6c3210 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.135165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80714d-76b5-4c6b-b078-fcd9aa6c3210 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.135445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80714d-76b5-4c6b-b078-fcd9aa6c3210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.155603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8e80714d-76b5-4c6b-b078-fcd9aa6c3210 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:43.157057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8e80714d-76b5-4c6b-b078-fcd9aa6c3210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:43.194608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 218/434] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:15:43.200097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0be30-c021-4467-b9be-544bd8623956 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.203604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.230678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 217/435] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:43.231521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80714d-76b5-4c6b-b078-fcd9aa6c3210 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.260276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.300886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0be30-c021-4467-b9be-544bd8623956 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.333070 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfadbc1-ca98-4c1f-aef1-7e12ff25c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.333687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfadbc1-ca98-4c1f-aef1-7e12ff25c100 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.333963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfadbc1-ca98-4c1f-aef1-7e12ff25c100 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.334269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfadbc1-ca98-4c1f-aef1-7e12ff25c100 None admin] PATH_INFO: `/v3/projects/ea16686f0e7343b88fa1696b8b1715ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.335368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfadbc1-ca98-4c1f-aef1-7e12ff25c100 None admin] RBAC: Authorizing `identity:get_project(project_id=ea16686f0e7343b88fa1696b8b1715ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:43.336780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfadbc1-ca98-4c1f-aef1-7e12ff25c100 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:43.338723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 219/436] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/projects/ea16686f0e7343b88fa1696b8b1715ed => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:43.339825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f04aa-40b4-472e-896c-2a7edada4318 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.340109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f04aa-40b4-472e-896c-2a7edada4318 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.340383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f04aa-40b4-472e-896c-2a7edada4318 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.341571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 220/437] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:43.345551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f04aa-40b4-472e-896c-2a7edada4318 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.347544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80714d-76b5-4c6b-b078-fcd9aa6c3210 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.381846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708bd2-72b3-4d57-affc-b6e1f327c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.382486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708bd2-72b3-4d57-affc-b6e1f327c99c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.382773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708bd2-72b3-4d57-affc-b6e1f327c99c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.383047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708bd2-72b3-4d57-affc-b6e1f327c99c None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.384207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2708bd2-72b3-4d57-affc-b6e1f327c99c None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:43.385595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2708bd2-72b3-4d57-affc-b6e1f327c99c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:43.387421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 218/438] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:43.387984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708bd2-72b3-4d57-affc-b6e1f327c99c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.438329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.446269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f04aa-40b4-472e-896c-2a7edada4318 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.473513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.481735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cf79a-70b3-481e-94cb-b0a0242d3204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.482388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf79a-70b3-481e-94cb-b0a0242d3204 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.482667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf79a-70b3-481e-94cb-b0a0242d3204 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.482937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf79a-70b3-481e-94cb-b0a0242d3204 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.493415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cf79a-70b3-481e-94cb-b0a0242d3204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:43.493762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708bd2-72b3-4d57-affc-b6e1f327c99c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-2b1cf79a-70b3-481e-94cb-b0a0242d3204 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:43.498125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:43.498990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:43.499797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 221/439] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:43.500461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c1ac-b6ad-44e3-baf7-2b207efb6f44 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.500631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c1ac-b6ad-44e3-baf7-2b207efb6f44 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.500861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c1ac-b6ad-44e3-baf7-2b207efb6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.518848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4bf0c1ac-b6ad-44e3-baf7-2b207efb6f44 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:43.520319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4bf0c1ac-b6ad-44e3-baf7-2b207efb6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:43.534234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5cb77-717c-49bb-b25e-d717e59bc931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.534851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cb77-717c-49bb-b25e-d717e59bc931 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.535133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cb77-717c-49bb-b25e-d717e59bc931 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.535409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cb77-717c-49bb-b25e-d717e59bc931 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.536538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5cb77-717c-49bb-b25e-d717e59bc931 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:43.537984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5cb77-717c-49bb-b25e-d717e59bc931 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:43.544422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 219/440] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:43.544422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5cb77-717c-49bb-b25e-d717e59bc931 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.585638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 222/441] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:43.586595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0c1ac-b6ad-44e3-baf7-2b207efb6f44 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.641651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5cb77-717c-49bb-b25e-d717e59bc931 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.654422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.675953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d55b9-3900-4832-9fb6-e4b31785b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.676562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d55b9-3900-4832-9fb6-e4b31785b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.676841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d55b9-3900-4832-9fb6-e4b31785b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.677112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d55b9-3900-4832-9fb6-e4b31785b3e4 None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.678319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d55b9-3900-4832-9fb6-e4b31785b3e4 None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:43.679745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d55b9-3900-4832-9fb6-e4b31785b3e4 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:43.681584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 220/442] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:43.682371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d55b9-3900-4832-9fb6-e4b31785b3e4 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.688871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0c1ac-b6ad-44e3-baf7-2b207efb6f44 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.707376 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.725298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.725898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.726216 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.726491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.727150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:43.727455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:43.728815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:43.737373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 223/443] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:43.738208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.785274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d55b9-3900-4832-9fb6-e4b31785b3e4 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.818187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.819165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.819458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.819735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.820463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] RBAC: Adding query filter params (group.id=9c86b9fc045a464aadb49649304057b7, role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=ea16686f0e7343b88fa1696b8b1715ed) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:43.820777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:43.823187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:43.829110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 221/444] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/role_assignments?group.id=9c86b9fc045a464aadb49649304057b7&scope.project.id=ea16686f0e7343b88fa1696b8b1715ed&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:43.829893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.836054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2a73-d3f0-480d-94cb-a810a3265d72 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:43.876321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d350-7a36-4b5b-8841-2b04abff20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:43.876959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d350-7a36-4b5b-8841-2b04abff20f2 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:43.877342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d350-7a36-4b5b-8841-2b04abff20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:43.877497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d350-7a36-4b5b-8841-2b04abff20f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:43.891300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.891523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871d350-7a36-4b5b-8841-2b04abff20f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-4871d350-7a36-4b5b-8841-2b04abff20f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:43.896869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:43.897967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 224/445] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:43.899497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d350-7a36-4b5b-8841-2b04abff20f2 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:43.944172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:43.961093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d76e-d973-4c0a-880b-7839620b8c58 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.004323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.004924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.005201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.005471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.006462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] RBAC: Adding query filter params (group.id=9c86b9fc045a464aadb49649304057b7, role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:44.006571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.007980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.012790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d350-7a36-4b5b-8841-2b04abff20f2 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.015032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 222/446] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/role_assignments?group.id=9c86b9fc045a464aadb49649304057b7&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:44.015904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:44.063058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908482-d1c4-460d-81ea-07748bba0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.063641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908482-d1c4-460d-81ea-07748bba0b5a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.063918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908482-d1c4-460d-81ea-07748bba0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.064186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908482-d1c4-460d-81ea-07748bba0b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.154427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03a82-8f8e-442a-8e6c-c45138780b38 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.166291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:44.170090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908482-d1c4-460d-81ea-07748bba0b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.172128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908482-d1c4-460d-81ea-07748bba0b5a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.200054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.200677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.200956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.201229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.202047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:44.202445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.203846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.215682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 223/447] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:44.221486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:44.225416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:44.303530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 225/448] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:44.307288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908482-d1c4-460d-81ea-07748bba0b5a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:44.339865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed3fe8-bd1b-4274-8fa3-1fb866406934 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.384814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43263e68-f6a4-4d23-9a60-61d58be236c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.385429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263e68-f6a4-4d23-9a60-61d58be236c4 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.385707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263e68-f6a4-4d23-9a60-61d58be236c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.385975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263e68-f6a4-4d23-9a60-61d58be236c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.433010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908482-d1c4-460d-81ea-07748bba0b5a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.433279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:44.473491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43263e68-f6a4-4d23-9a60-61d58be236c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.475272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43263e68-f6a4-4d23-9a60-61d58be236c4 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.480596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58c138-288f-4f49-bb2f-4c471654fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.481229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58c138-288f-4f49-bb2f-4c471654fb70 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.481513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58c138-288f-4f49-bb2f-4c471654fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.481788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58c138-288f-4f49-bb2f-4c471654fb70 None admin] PATH_INFO: `/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.482984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58c138-288f-4f49-bb2f-4c471654fb70 None admin] RBAC: Authorizing `identity:get_project(project_id=c2bbcd4a1f6a42dcb7f98d6bb69581ae)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.484422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58c138-288f-4f49-bb2f-4c471654fb70 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.486303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 226/449] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:44 2022] GET /identity/v3/projects/c2bbcd4a1f6a42dcb7f98d6bb69581ae => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:44.491431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58c138-288f-4f49-bb2f-4c471654fb70 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:44.502690 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:44.602499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 224/450] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:44.607217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58c138-288f-4f49-bb2f-4c471654fb70 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.608388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43263e68-f6a4-4d23-9a60-61d58be236c4 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:44.642000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f598c-4328-4244-9a9b-18ad79556dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.642659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f598c-4328-4244-9a9b-18ad79556dbe None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.642932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f598c-4328-4244-9a9b-18ad79556dbe None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.643203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f598c-4328-4244-9a9b-18ad79556dbe None admin] PATH_INFO: `/v3/groups/79efb0a47a6f484ea1001e39b215d882` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.644918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f598c-4328-4244-9a9b-18ad79556dbe None admin] RBAC: Authorizing `identity:get_group(group_id=79efb0a47a6f484ea1001e39b215d882)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.646365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f598c-4328-4244-9a9b-18ad79556dbe None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.647913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 227/451] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:44 2022] GET /identity/v3/groups/79efb0a47a6f484ea1001e39b215d882 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:44.653483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f598c-4328-4244-9a9b-18ad79556dbe None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:44.677616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:44.709470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43263e68-f6a4-4d23-9a60-61d58be236c4 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.726627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:44.742571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12b9f-af0f-4d80-91e1-3334f7538dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.743202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12b9f-af0f-4d80-91e1-3334f7538dcc None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.743478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12b9f-af0f-4d80-91e1-3334f7538dcc None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.743757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12b9f-af0f-4d80-91e1-3334f7538dcc None admin] PATH_INFO: `/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.744871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a12b9f-af0f-4d80-91e1-3334f7538dcc None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4f3487ce94cc4b6371ef214d4c512)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.746344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a12b9f-af0f-4d80-91e1-3334f7538dcc None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.748004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 225/452] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:15:44 2022] GET /identity/v3/projects/9fd4f3487ce94cc4b6371ef214d4c512 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:44.749409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f598c-4328-4244-9a9b-18ad79556dbe None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.754281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12b9f-af0f-4d80-91e1-3334f7538dcc None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:44.791328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.792067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.792446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.792837 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.793640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] RBAC: Adding query filter params (group.id=79efb0a47a6f484ea1001e39b215d882, role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=c2bbcd4a1f6a42dcb7f98d6bb69581ae) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:44.794048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.795570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.801890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 228/453] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:44 2022] GET /identity/v3/role_assignments?group.id=79efb0a47a6f484ea1001e39b215d882&scope.project.id=c2bbcd4a1f6a42dcb7f98d6bb69581ae&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:44.870324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12b9f-af0f-4d80-91e1-3334f7538dcc None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:44.905323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9fd4-08b4-4fbf-9b8d-0d354e390a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:44.905960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9fd4-08b4-4fbf-9b8d-0d354e390a8f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:44.906262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9fd4-08b4-4fbf-9b8d-0d354e390a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:44.906533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9fd4-08b4-4fbf-9b8d-0d354e390a8f None admin] PATH_INFO: `/v3/groups/9c86b9fc045a464aadb49649304057b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:44.907694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d9fd4-08b4-4fbf-9b8d-0d354e390a8f None admin] RBAC: Authorizing `identity:get_group(group_id=9c86b9fc045a464aadb49649304057b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:44.909150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d9fd4-08b4-4fbf-9b8d-0d354e390a8f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:44.910799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 226/454] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Aug 8 00:15:44 2022] GET /identity/v3/groups/9c86b9fc045a464aadb49649304057b7 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:44.916799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:45.017165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc872ed-9849-4aac-9152-27f2faf226d0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:45.049268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ee17-2ebe-4cc6-a71f-42ac262badc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:45.050385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ee17-2ebe-4cc6-a71f-42ac262badc4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:45.050662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ee17-2ebe-4cc6-a71f-42ac262badc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:45.050936 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ee17-2ebe-4cc6-a71f-42ac262badc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:45.051645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ee17-2ebe-4cc6-a71f-42ac262badc4 None admin] RBAC: Adding query filter params (group.id=9c86b9fc045a464aadb49649304057b7, role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:45.051954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ee17-2ebe-4cc6-a71f-42ac262badc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:45.053365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ee17-2ebe-4cc6-a71f-42ac262badc4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:45.058937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 229/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Aug 8 00:15:44 2022] GET /identity/v3/role_assignments?group.id=9c86b9fc045a464aadb49649304057b7&scope.project.id=9fd4f3487ce94cc4b6371ef214d4c512&role.id=45f0e969ef594665877c4596781ce6aa => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:47.641609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dba0-0201-4171-a145-a63f03d8794e None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:47.642160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dba0-0201-4171-a145-a63f03d8794e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:47.642265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dba0-0201-4171-a145-a63f03d8794e None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:47.644571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 227/456] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:47.662686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cad97-9a5a-4c5b-b84f-5636082abd10 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:47.663162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cad97-9a5a-4c5b-b84f-5636082abd10 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:47.663233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cad97-9a5a-4c5b-b84f-5636082abd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:47.675218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:47.686207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d52cad97-9a5a-4c5b-b84f-5636082abd10 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:47.687418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d52cad97-9a5a-4c5b-b84f-5636082abd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:47.786470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 230/457] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:47.827847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471dba0-0201-4171-a145-a63f03d8794e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:47.838644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:47.878576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e4259-27b8-4fd1-86ce-cb85e8336503 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:47.878865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e4259-27b8-4fd1-86ce-cb85e8336503 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:47.879124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e4259-27b8-4fd1-86ce-cb85e8336503 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:47.880465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 231/458] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:47.896441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774884-92d5-4b1a-8951-cd3715bb4810 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:47.896709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774884-92d5-4b1a-8951-cd3715bb4810 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:47.896925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774884-92d5-4b1a-8951-cd3715bb4810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:47.926994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6c774884-92d5-4b1a-8951-cd3715bb4810 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:47.928186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6c774884-92d5-4b1a-8951-cd3715bb4810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:47.972432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471dba0-0201-4171-a145-a63f03d8794e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.037220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.037914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.038221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.038496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.049518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 232/459] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:48.058186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f603-eb54-4f7b-8323-c7521e4ce78f None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.058521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f603-eb54-4f7b-8323-c7521e4ce78f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.058746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f603-eb54-4f7b-8323-c7521e4ce78f None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.060440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 233/460] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:48.063404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.064915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.066600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6250915-dc8e-4de2-b9be-db69490e41ed None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.066888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6250915-dc8e-4de2-b9be-db69490e41ed None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.067160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6250915-dc8e-4de2-b9be-db69490e41ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.089637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f6250915-dc8e-4de2-b9be-db69490e41ed None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:48.090923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f6250915-dc8e-4de2-b9be-db69490e41ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:48.096216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:48.097164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:48.098021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:48.098021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:48.098021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:48.098021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 228/461] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:48.099016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.164158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:48.173404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:48.175245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 234/462] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:48.176292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6250915-dc8e-4de2-b9be-db69490e41ed None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.240843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8e396-e0eb-4c3b-a810-c59a4d020c13 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.276657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.277312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.277591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.277864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.292373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.293834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:48.308994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:48.309901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:48.310766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:48.310766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:48.310766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:48.310766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 229/463] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:48.310993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.320196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6250915-dc8e-4de2-b9be-db69490e41ed None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.357115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.358110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.358581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.358932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.359570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:48.359874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.361234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.380755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 235/464] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:48.381405 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.429853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82a704-cead-4b8d-9b6d-e26300892f70 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.441405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:48.444482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:48.467421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccb9bd-afc9-4f49-ad9b-d27e0b741265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.468094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccb9bd-afc9-4f49-ad9b-d27e0b741265 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.468379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccb9bd-afc9-4f49-ad9b-d27e0b741265 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.468654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccb9bd-afc9-4f49-ad9b-d27e0b741265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.480549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccb9bd-afc9-4f49-ad9b-d27e0b741265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.482003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccb9bd-afc9-4f49-ad9b-d27e0b741265 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.494358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff7fef-82c9-4558-b42f-b3972081b563 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-abccb9bd-afc9-4f49-ad9b-d27e0b741265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:48.500103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:48.500982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:48.501811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:48.501811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:48.501811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:48.501811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 230/465] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:48.502748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db3f1-cb52-47d4-a509-a88ff89d99e1 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.503070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db3f1-cb52-47d4-a509-a88ff89d99e1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.503347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db3f1-cb52-47d4-a509-a88ff89d99e1 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.508505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 231/466] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:48.508505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9db3f1-cb52-47d4-a509-a88ff89d99e1 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.536973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.537586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.537870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.538186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.538834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:48.539140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.540504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.552512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 236/467] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:48.553377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.629503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9db3f1-cb52-47d4-a509-a88ff89d99e1 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.661306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429f24d-9df7-41ca-9806-6cbca09db04b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.665681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49978780-06a2-40c5-90fe-7759aa5f0bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.666328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978780-06a2-40c5-90fe-7759aa5f0bcd None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.666610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978780-06a2-40c5-90fe-7759aa5f0bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.666883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978780-06a2-40c5-90fe-7759aa5f0bcd None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.667530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49978780-06a2-40c5-90fe-7759aa5f0bcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.668985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49978780-06a2-40c5-90fe-7759aa5f0bcd None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.679588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:48.691506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 232/468] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:48 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:48.692750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b573b4-14a8-44b8-8f39-0ead2e0d0781 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.693042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b573b4-14a8-44b8-8f39-0ead2e0d0781 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.693321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b573b4-14a8-44b8-8f39-0ead2e0d0781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.712273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e2b573b4-14a8-44b8-8f39-0ead2e0d0781 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:48.713579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e2b573b4-14a8-44b8-8f39-0ead2e0d0781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:48.715342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.716634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.718305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.718851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.719797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:48.720382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.722831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.730398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:48.747206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 237/469] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:48.747206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.804938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 233/470] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:48.806180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b573b4-14a8-44b8-8f39-0ead2e0d0781 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.895768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d4fcc-fe18-4942-a8df-877ceed2ecfc None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.923963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b573b4-14a8-44b8-8f39-0ead2e0d0781 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:48.936607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1eb131-f35e-47a8-88dd-b0b6e1a24e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.937219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eb131-f35e-47a8-88dd-b0b6e1a24e2d None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.937544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eb131-f35e-47a8-88dd-b0b6e1a24e2d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.937827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eb131-f35e-47a8-88dd-b0b6e1a24e2d None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.938502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1eb131-f35e-47a8-88dd-b0b6e1a24e2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.939941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1eb131-f35e-47a8-88dd-b0b6e1a24e2d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.965548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c446ca-1d99-49bb-82c5-ef1dae77af91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:48.966591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c446ca-1d99-49bb-82c5-ef1dae77af91 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:48.967122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c446ca-1d99-49bb-82c5-ef1dae77af91 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:48.967548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c446ca-1d99-49bb-82c5-ef1dae77af91 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:48.968250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c446ca-1d99-49bb-82c5-ef1dae77af91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:48.968365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 238/471] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:48 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:48.969209 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1eb131-f35e-47a8-88dd-b0b6e1a24e2d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:48.969839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c446ca-1d99-49bb-82c5-ef1dae77af91 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:48.996586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 234/472] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:48 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:49.010234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fd637-6e57-4ea7-a0f2-29fcd60d5cd4 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:49.010549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fd637-6e57-4ea7-a0f2-29fcd60d5cd4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:49.010800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fd637-6e57-4ea7-a0f2-29fcd60d5cd4 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:49.012772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 235/473] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:49.015551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:49.018657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade08147-ffec-4a14-aa92-27de9bd1c1c8 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:49.019429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade08147-ffec-4a14-aa92-27de9bd1c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:49.019849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade08147-ffec-4a14-aa92-27de9bd1c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:49.029444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:49.043481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-ade08147-ffec-4a14-aa92-27de9bd1c1c8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:49.044695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ade08147-ffec-4a14-aa92-27de9bd1c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:49.110099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1eb131-f35e-47a8-88dd-b0b6e1a24e2d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:49.147504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 236/474] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:49.166579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade08147-ffec-4a14-aa92-27de9bd1c1c8 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:49.172568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:49.173215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:49.173592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:49.173946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:49.186940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:49.189067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:49.207802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:49.209179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:49.210079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:49.210079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:49.210079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:49.212586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 239/475] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:49.219672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:49.295243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade08147-ffec-4a14-aa92-27de9bd1c1c8 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:49.325806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:49.343833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:49.344445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:49.344726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:49.345002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:49.345665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:49.347736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:49.348945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f83f2-eb87-4f01-ac6d-45490f716f2d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:49.352525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:49.358447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.sql.core [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 00:15:49.358447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 00:15:49.358447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [parameters: {'id': '8a77093433bb43f7b36e28305dea0871', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 00:15:49.358447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86589) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application conn.query(q) Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application result.read() Aug 08 00:15:49.376544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return ref.to_dict() Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 00:15:49.377470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application next(self.gen) Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application yield resource Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application next(self.gen) Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise self.value Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application session.commit() Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 00:15:49.378519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.session.flush() Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application compat.raise_( Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 00:15:49.379369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 00:15:49.380221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application conn.query(q) Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application result.read() Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 00:15:49.381025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [parameters: {'id': '8a77093433bb43f7b36e28305dea0871', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:49.381800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 00:15:49.382953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:49.384764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 237/476] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 00:15:49 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:49.384764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:49.394492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:49.395120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:49.395404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:49.395681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:49.396336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:49.396642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:49.398033 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:49.418541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 240/477] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:15:49.424469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:49.540718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14ef9f-d61a-43f8-be33-7a74148593d8 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:49.574123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d89ff-5056-4bcb-b296-4a3940ecde20 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:49.585356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620100-5e81-4b3a-97ed-5ebf1161f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:49.586001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620100-5e81-4b3a-97ed-5ebf1161f43b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:49.586414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620100-5e81-4b3a-97ed-5ebf1161f43b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:49.586693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620100-5e81-4b3a-97ed-5ebf1161f43b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:49.604917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b620100-5e81-4b3a-97ed-5ebf1161f43b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:49.611260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e93e2d-b38e-4105-a6c0-e3fec802a6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:49.611920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e93e2d-b38e-4105-a6c0-e3fec802a6f6 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:49.612244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e93e2d-b38e-4105-a6c0-e3fec802a6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:49.612519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e93e2d-b38e-4105-a6c0-e3fec802a6f6 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:49.613158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e93e2d-b38e-4105-a6c0-e3fec802a6f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:49.615022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e93e2d-b38e-4105-a6c0-e3fec802a6f6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-4b620100-5e81-4b3a-97ed-5ebf1161f43b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:49.619958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:49.621007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:49.621882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 238/478] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:15:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:49.626854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620100-5e81-4b3a-97ed-5ebf1161f43b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:49.640006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:49.646169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 241/479] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:49 2022] POST /identity/v3/users => generated 249 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:49.710128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:49.766346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620100-5e81-4b3a-97ed-5ebf1161f43b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:49.815988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bc27f-a106-4e9e-b7b1-dfc572ee260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:49.816962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bc27f-a106-4e9e-b7b1-dfc572ee260c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:49.817464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bc27f-a106-4e9e-b7b1-dfc572ee260c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:49.817939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bc27f-a106-4e9e-b7b1-dfc572ee260c None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:49.818863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bc27f-a106-4e9e-b7b1-dfc572ee260c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:49.819378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bc27f-a106-4e9e-b7b1-dfc572ee260c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:49.821044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bc27f-a106-4e9e-b7b1-dfc572ee260c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:49.831548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 239/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:51.191228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c511-e13b-4f62-8049-092efeafe22e None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.191725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c511-e13b-4f62-8049-092efeafe22e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.191725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c511-e13b-4f62-8049-092efeafe22e None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.193266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 242/481] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:51.198608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d124b61-5949-4345-a7fd-8b27ee3c1d0a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.198983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d124b61-5949-4345-a7fd-8b27ee3c1d0a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.199165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d124b61-5949-4345-a7fd-8b27ee3c1d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.217921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7d124b61-5949-4345-a7fd-8b27ee3c1d0a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:51.219160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7d124b61-5949-4345-a7fd-8b27ee3c1d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:51.292640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 240/482] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:51.315377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c511-e13b-4f62-8049-092efeafe22e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:51.435800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c511-e13b-4f62-8049-092efeafe22e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:51.482607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304432c9-cd87-40be-af12-04a8262197ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:51.483237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304432c9-cd87-40be-af12-04a8262197ab None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.483518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304432c9-cd87-40be-af12-04a8262197ab None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.483789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304432c9-cd87-40be-af12-04a8262197ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.494419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304432c9-cd87-40be-af12-04a8262197ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-304432c9-cd87-40be-af12-04a8262197ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:51.499595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:51.500457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:51.502328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 243/483] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:51.507287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d124b61-5949-4345-a7fd-8b27ee3c1d0a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:51.562476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:51.610589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d124b61-5949-4345-a7fd-8b27ee3c1d0a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:51.646322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d4abc-6721-4619-89ab-92c9c6efb82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:51.646816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4abc-6721-4619-89ab-92c9c6efb82c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.647098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4abc-6721-4619-89ab-92c9c6efb82c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.647372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4abc-6721-4619-89ab-92c9c6efb82c None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.648036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d4abc-6721-4619-89ab-92c9c6efb82c None admin] RBAC: Adding query filter params (name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:51.648342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d4abc-6721-4619-89ab-92c9c6efb82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:51.649794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d4abc-6721-4619-89ab-92c9c6efb82c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:51.658351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 241/484] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:15:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:51.664444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304432c9-cd87-40be-af12-04a8262197ab None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:51.669835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae27e8d-3ec3-4322-9e06-387a1f03dcf6 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.669835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae27e8d-3ec3-4322-9e06-387a1f03dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.669835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae27e8d-3ec3-4322-9e06-387a1f03dcf6 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.669835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 242/485] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:15:51.686394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba888-83df-49cc-b67c-9597421853de None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.686972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba888-83df-49cc-b67c-9597421853de None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.687462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba888-83df-49cc-b67c-9597421853de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.721203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a42ba888-83df-49cc-b67c-9597421853de None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:51.723433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a42ba888-83df-49cc-b67c-9597421853de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:51.753469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:51.822559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304432c9-cd87-40be-af12-04a8262197ab None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:51.827851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 243/486] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:51.827851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b0ba-f7f5-4156-ab2e-50eb529aa4ec None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.827851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b0ba-f7f5-4156-ab2e-50eb529aa4ec None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.827851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b0ba-f7f5-4156-ab2e-50eb529aa4ec None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.832512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 244/487] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:51.835104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265615-368c-442b-bc36-4e376aa94f4d None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.835389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265615-368c-442b-bc36-4e376aa94f4d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.835663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265615-368c-442b-bc36-4e376aa94f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.857114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7f265615-368c-442b-bc36-4e376aa94f4d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:51.858355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7f265615-368c-442b-bc36-4e376aa94f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:51.892575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:51.893789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:51.894313 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:51.894565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:51.906707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:51.907489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:51.909715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:51.926154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:51.927089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:51.927939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:51.927939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:51.927939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:51.927939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 244/488] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:51.928717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:51.944290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 245/489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:15:51.945469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f265615-368c-442b-bc36-4e376aa94f4d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.052682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f265615-368c-442b-bc36-4e376aa94f4d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.061419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886209c9-3b0f-4096-a9f5-288204b5540e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.072741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:52.091823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.092753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.093226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.093761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.094811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:52.095319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:52.097169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:52.099248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9923fdb-3f2e-48ca-8958-9bb48c96e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.100194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923fdb-3f2e-48ca-8958-9bb48c96e22e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.100395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923fdb-3f2e-48ca-8958-9bb48c96e22e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.100673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923fdb-3f2e-48ca-8958-9bb48c96e22e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.110568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 246/490] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:52.111567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9923fdb-3f2e-48ca-8958-9bb48c96e22e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:52.112530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-b9923fdb-3f2e-48ca-8958-9bb48c96e22e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:52.117887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:52.118812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:52.119610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:52.123843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 245/491] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:52.124695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9923fdb-3f2e-48ca-8958-9bb48c96e22e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.150595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:52.229122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13014f5-e522-45e0-b3b4-ee8554285184 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.236764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9923fdb-3f2e-48ca-8958-9bb48c96e22e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.268016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae0cc-95e2-4170-a9f3-335b11d68141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.269306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae0cc-95e2-4170-a9f3-335b11d68141 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.269779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae0cc-95e2-4170-a9f3-335b11d68141 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.270296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae0cc-95e2-4170-a9f3-335b11d68141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.273626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffe8f-cfb3-446b-a619-ec6fb1baaa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.274289 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffe8f-cfb3-446b-a619-ec6fb1baaa46 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.274573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffe8f-cfb3-446b-a619-ec6fb1baaa46 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.274845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffe8f-cfb3-446b-a619-ec6fb1baaa46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.282000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ae0cc-95e2-4170-a9f3-335b11d68141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:52.282983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffe8f-cfb3-446b-a619-ec6fb1baaa46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:52.284969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffe8f-cfb3-446b-a619-ec6fb1baaa46 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-745ae0cc-95e2-4170-a9f3-335b11d68141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:52.288130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:52.289005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:52.289780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:52.292309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 247/492] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:52.293343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae0cc-95e2-4170-a9f3-335b11d68141 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-7d3ffe8f-cfb3-446b-a619-ec6fb1baaa46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:15:52.303674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:52.304681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:52.305567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 246/493] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:52.306614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0fd7-d810-4d97-8a49-d562eed69617 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.306777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0fd7-d810-4d97-8a49-d562eed69617 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.307007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0fd7-d810-4d97-8a49-d562eed69617 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.308476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 247/494] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:52.312426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb0fd7-d810-4d97-8a49-d562eed69617 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.341106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:52.394909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:52.404342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae0cc-95e2-4170-a9f3-335b11d68141 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.423944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb0fd7-d810-4d97-8a49-d562eed69617 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.442361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.442967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.443251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.443526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.444335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] RBAC: Adding query filter params (name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:52.444640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:52.446021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:52.460088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 248/495] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:52.460088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.462443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891c5fa-f85e-494b-8c44-e0ff6d7c8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.463052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891c5fa-f85e-494b-8c44-e0ff6d7c8af5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.463332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891c5fa-f85e-494b-8c44-e0ff6d7c8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.463605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891c5fa-f85e-494b-8c44-e0ff6d7c8af5 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.464301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891c5fa-f85e-494b-8c44-e0ff6d7c8af5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:52.464606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891c5fa-f85e-494b-8c44-e0ff6d7c8af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:52.465972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891c5fa-f85e-494b-8c44-e0ff6d7c8af5 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:52.479683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 248/496] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:52.479683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982b685-7fe2-440a-a82f-8b2a43091cc3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.479683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982b685-7fe2-440a-a82f-8b2a43091cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.479683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982b685-7fe2-440a-a82f-8b2a43091cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.495534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-3982b685-7fe2-440a-a82f-8b2a43091cc3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:52.496723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3982b685-7fe2-440a-a82f-8b2a43091cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:52.566156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 249/497] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:52.566156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982b685-7fe2-440a-a82f-8b2a43091cc3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.566472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb36a01-1940-4ce2-a2c6-deb2e97afd95 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.589482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:52.602587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.603187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.603466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.603739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.604459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:52.604766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:52.606686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:52.643249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 249/498] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:52.644310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.660310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:52.666915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982b685-7fe2-440a-a82f-8b2a43091cc3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.700951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229fbb9-62eb-4698-a68d-f71b1705a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.701570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229fbb9-62eb-4698-a68d-f71b1705a39a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.701849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229fbb9-62eb-4698-a68d-f71b1705a39a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.702149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229fbb9-62eb-4698-a68d-f71b1705a39a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.711855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229fbb9-62eb-4698-a68d-f71b1705a39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:52.713279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229fbb9-62eb-4698-a68d-f71b1705a39a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-e229fbb9-62eb-4698-a68d-f71b1705a39a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:52.727482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:52.728541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:52.729389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:52.729389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:52.729389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:52.729389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 250/499] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:52.729996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8daf0-bba5-4f64-938d-9823e888b840 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.730304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8daf0-bba5-4f64-938d-9823e888b840 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.730574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8daf0-bba5-4f64-938d-9823e888b840 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.731798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 251/500] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:52.732487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8daf0-bba5-4f64-938d-9823e888b840 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.750637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34ed27-fe89-4f58-8338-4f773ef753e4 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.785718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.786371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.786651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.786923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.796972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:52.798519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:52.811325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:52.813657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:52.814603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:52.815693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:52.815693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:52.815693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:52.815693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 250/501] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:52.816938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.841664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8daf0-bba5-4f64-938d-9823e888b840 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.876357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:52.880145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516c364-39f7-487c-af21-10d5a54062d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.880796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c364-39f7-487c-af21-10d5a54062d2 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.881077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c364-39f7-487c-af21-10d5a54062d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.881345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c364-39f7-487c-af21-10d5a54062d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:52.891872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516c364-39f7-487c-af21-10d5a54062d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-6516c364-39f7-487c-af21-10d5a54062d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:52.897026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:52.898016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:52.898941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 252/502] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:52.899649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516c364-39f7-487c-af21-10d5a54062d2 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:52.920427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488126c1-c540-4be0-bfce-44bd1decc2ee None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:52.959863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611a77a-9262-4b2f-9db6-66f5d1927772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:52.960460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611a77a-9262-4b2f-9db6-66f5d1927772 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:52.960739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611a77a-9262-4b2f-9db6-66f5d1927772 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:52.961012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611a77a-9262-4b2f-9db6-66f5d1927772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.003168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516c364-39f7-487c-af21-10d5a54062d2 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.028070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611a77a-9262-4b2f-9db6-66f5d1927772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.029543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611a77a-9262-4b2f-9db6-66f5d1927772 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.035894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed273a-3f52-400d-bacf-2a3300878d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.036476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed273a-3f52-400d-bacf-2a3300878d0a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.036752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed273a-3f52-400d-bacf-2a3300878d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.037022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed273a-3f52-400d-bacf-2a3300878d0a None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.037656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed273a-3f52-400d-bacf-2a3300878d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:53.037957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed273a-3f52-400d-bacf-2a3300878d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.039323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed273a-3f52-400d-bacf-2a3300878d0a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.040981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.052867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 253/503] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:53.054121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad72e7-8f5a-4bae-bbc1-888c1c567e81 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.054401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad72e7-8f5a-4bae-bbc1-888c1c567e81 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.054670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad72e7-8f5a-4bae-bbc1-888c1c567e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.071417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-2bad72e7-8f5a-4bae-bbc1-888c1c567e81 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:53.072544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2bad72e7-8f5a-4bae-bbc1-888c1c567e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:53.093857 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.132806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 251/504] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:53.133640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611a77a-9262-4b2f-9db6-66f5d1927772 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.142270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 254/505] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:53.143097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad72e7-8f5a-4bae-bbc1-888c1c567e81 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.232278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611a77a-9262-4b2f-9db6-66f5d1927772 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.244994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad72e7-8f5a-4bae-bbc1-888c1c567e81 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.266558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.267158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.267435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.267714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.267836 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.269132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:53.269439 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.270877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.279856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.280460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.280762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.281035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.281720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:53.282010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 252/506] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:53.282171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.282893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.283459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.296416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 255/507] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:53.296416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.313088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.388176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9b3f1-c063-432f-95b1-0f1487c9d28f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.388581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c36259-98d4-4f00-8f80-55d8853f1338 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.421473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.422035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.422185 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.422383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.422656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.422742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.422944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.423217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.431326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.432787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.433819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.435263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:15:53.445025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:53.446109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 253/508] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:53.447003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:53.448697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:53.449536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:53.451137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:53.451137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:53.451137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:53.454153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 256/509] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:53.454862 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.495147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.533430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.549518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a53b42-497b-40bb-8b0c-a93cde1021cf None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.555792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfc13c-dd67-43b2-af8b-ea96f535c3be None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.582945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.583559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.583839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.584117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.588813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.589422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.589703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.590003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.594330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.595786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.597854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.599323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:53.609984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:53.610960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:53.611821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:53.611821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:53.611821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:15:53.612020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:53.612831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 00:15:53.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:53.614266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 254/510] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:53.614266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.615697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 257/511] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:53.616408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.709620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.713411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb442249-4184-468d-8f73-cd9cbbd5df9b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.713767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809987a8-560a-4a50-bd74-89aebea8b3df None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.745957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.746594 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.746877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.746993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.747145 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.747464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.747739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.748014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.748726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:53.749031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.749920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.750467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.759312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.760736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:53.775195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:53.776167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:53.777163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:53.777163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:53.777163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:53.777163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 255/512] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:53.777514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.790031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 258/513] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:53.790884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.879735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da0def-24a0-4478-9643-b6a75812f41c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.891493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86633a-e24d-4d5d-8b4f-b1e5087986f9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:53.912857 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.913452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.913731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.914003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.914666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:53.914968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.916333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.925180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:53.925780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:53.926074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:53.926370 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:53.927091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:53.927398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:53.927944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 256/514] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:53.928728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.928827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:53.946633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 259/515] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:53.947443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:53.962645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:53.982671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.033131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919f164-33c0-4d6d-93a8-fa2dfa5f1345 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.045774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9c2c8-4a6c-4f76-ab7f-90cf2d516eaa None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.067473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.068144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.068491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.068831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.069531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:54.069902 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.071401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.080316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.081405 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.081683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.081954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.082617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:54.082923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.083012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 257/516] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:54.083700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.084338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.095537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 260/517] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:54.096381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.169207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.191625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789273d-4e7c-4034-ae05-a2dc92af082d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.194615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483ded-7c6d-47c2-ae24-5a86266e5f3a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.200336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.226174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc584f5-289f-4050-a6f4-1f15698af247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.226782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc584f5-289f-4050-a6f4-1f15698af247 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.227064 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc584f5-289f-4050-a6f4-1f15698af247 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.227334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc584f5-289f-4050-a6f4-1f15698af247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.232554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.233174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.233457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.233731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.240898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.242358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:15:54.254575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:54.255933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 261/518] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:54.256778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.300331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc584f5-289f-4050-a6f4-1f15698af247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.301928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc584f5-289f-4050-a6f4-1f15698af247 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.355429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8844af-d5b9-4d63-a4c4-6c5a43fcc003 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.388143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d08c46-43ad-44bf-8530-b43b227f4858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.388758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08c46-43ad-44bf-8530-b43b227f4858 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.389039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08c46-43ad-44bf-8530-b43b227f4858 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.389314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08c46-43ad-44bf-8530-b43b227f4858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.391850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.399329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 258/519] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:54.400168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc584f5-289f-4050-a6f4-1f15698af247 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.410295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.463341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d08c46-43ad-44bf-8530-b43b227f4858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.464785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d08c46-43ad-44bf-8530-b43b227f4858 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.498838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc584f5-289f-4050-a6f4-1f15698af247 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.531234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491553-044a-4c81-a449-763fbddbdc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.531828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491553-044a-4c81-a449-763fbddbdc73 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.532109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491553-044a-4c81-a449-763fbddbdc73 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.532386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491553-044a-4c81-a449-763fbddbdc73 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.533017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d491553-044a-4c81-a449-763fbddbdc73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.534999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d491553-044a-4c81-a449-763fbddbdc73 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.556760 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 259/520] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:15:54 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:15:54.557683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491553-044a-4c81-a449-763fbddbdc73 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.571413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 262/521] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:54.571413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d08c46-43ad-44bf-8530-b43b227f4858 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.611353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.636451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.683687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491553-044a-4c81-a449-763fbddbdc73 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.692242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d08c46-43ad-44bf-8530-b43b227f4858 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.724017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.724645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.724932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.725210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.734186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.735338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.735630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.735931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.736215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.736485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.737833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:54.738541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.739962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:15:54.747894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:54.748938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 260/522] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:54.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.760379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 263/523] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:54.761582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.873799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542c2e-653e-47ed-8eb9-d54a302e4eca None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.875840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.883269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a3c7-e6bd-4b47-bdeb-32f2a5d4bdbd None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:54.897830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:54.909608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.910262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.910549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.910822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.921800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.922706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:54.923305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.923406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:54.923594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:54.924044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:54.935087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:54.936574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:54.937141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:54.938360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:54.939558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:54.939558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:54.939558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:54.939558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 261/524] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:54.939558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:54.956140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:54.957072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:54.957935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:54.957935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:54.957935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:54.957935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 264/525] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:54.958717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.044906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e69cf2-174b-4ed6-aabb-6668f37d8a59 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.065969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fce330-1219-4481-9c04-d02179e6d698 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.080133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.080763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.081045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.081324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.082047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:55.082381 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.083822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.105421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.105610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 262/526] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:55.105688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.105688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.105809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.105902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.105902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=fe6573439abd4afb8098390eb4c7e5ef) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:55.105902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.105902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.118097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 265/527] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:54 2022] GET /identity/v3/role_assignments?user.id=fe6573439abd4afb8098390eb4c7e5ef&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:55.118097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.131086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:55.160899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:55.237040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f8ecf-5453-44e0-9155-3d237809d8df None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.269994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611171-51dc-468a-a1fc-a7e3ae2527aa None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.277553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.278217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.278570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.278970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.279688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:55.280000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.281377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.296280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 266/528] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:55.297846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.319365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.320337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.320337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.320622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.321244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:55.321549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.323076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.336916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 263/529] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:55.337871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.387458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:55.428227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09073a0-c5c0-4d51-9e4c-78ef88b8c036 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.442364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:55.450937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640aff2-0c6e-4520-852c-3775f6bfa8fb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.477105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f9f9-6114-478f-8bbc-2ffe128d6ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.477818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f9f9-6114-478f-8bbc-2ffe128d6ffb None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.478137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f9f9-6114-478f-8bbc-2ffe128d6ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.478415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f9f9-6114-478f-8bbc-2ffe128d6ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.491443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.492299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.492866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.493142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.501016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.503411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:15:55.517054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:55.517937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:55.519108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:15:55.519108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:15:55.519108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:15:55.519108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:15:55.519108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:15:55.519108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:15:55.519108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:15:55.519108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:55.523536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 264/530] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:55.524385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.562979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87f9f9-6114-478f-8bbc-2ffe128d6ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.564815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87f9f9-6114-478f-8bbc-2ffe128d6ffb None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.633399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ac646-65e2-43de-a51b-baa9769f809f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.645816 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:55.672762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.673353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.673639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.673908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.681912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.683548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.684136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 267/531] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:55.685381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f9f9-6114-478f-8bbc-2ffe128d6ffb None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:15:55.696181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:55.697065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:55.697912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:15:55.697912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:15:55.697912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:15:55.697912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:15:55.697912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:15:55.697912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:15:55.697912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:15:55.697912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:55.702123 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 265/532] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:55.703071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.722605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:55.799002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f9f9-6114-478f-8bbc-2ffe128d6ffb None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.816795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd088e-cd80-42d6-8841-21c8bdb842b0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:55.837010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.838052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.838561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.839053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.839926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:55.840494 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.842243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.858032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:55.858872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:55.859154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:55.859423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:55.862453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 268/533] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:55.863140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.879901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:55.882316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:55.899668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:55.901455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:55.902731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:55.903578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:55.903578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:55.903578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:55.903578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 266/534] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:55.904484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:55.977741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:56.014139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd50d2-dcc2-4767-9003-91b5b90cc757 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:56.016233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105a7c0-85f5-462d-93cc-495438fc4c67 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:56.053472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:56.054233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:56.054593 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:56.054985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:56.055854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=064dcac38bd1416f93bb1b763cb89f84) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:56.056217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:56.057740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:56.059306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:56.060315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:56.060777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:56.061648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:56.062773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:56.063237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:56.064049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 267/535] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/role_assignments?user.id=064dcac38bd1416f93bb1b763cb89f84&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:56.065142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:56.071270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:56.079724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 269/536] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:56.094851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:56.275743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:56.294055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85581f31-22fd-46aa-8911-48608fd8670a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:56.308118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2597e5-65cc-42fc-97e8-fd2f4e4b438f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:56.343401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:56.344353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:56.344838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:56.345305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:56.346785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=b1d5fb05964b47d5a2f33fe9dde1f65f) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:56.347292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:56.348904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:56.356140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:56.362571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 270/537] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:56 2022] GET /identity/v3/role_assignments?user.id=b1d5fb05964b47d5a2f33fe9dde1f65f&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:56.363733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:56.364341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:56.364619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:56.364891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:56.365539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:56.365842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:56.367340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:56.381603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 268/538] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:56.387218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:56.514950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f66e4-b57c-4462-a2bc-b62095a394db None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:56.564524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ab32-0623-4f7c-924c-d530ae95547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:56.565220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ab32-0623-4f7c-924c-d530ae95547f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:56.565504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ab32-0623-4f7c-924c-d530ae95547f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:56.565779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ab32-0623-4f7c-924c-d530ae95547f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:56.573673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ab32-0623-4f7c-924c-d530ae95547f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:56.575192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ab32-0623-4f7c-924c-d530ae95547f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-1096ab32-0623-4f7c-924c-d530ae95547f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:15:56.591835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:56.592810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:56.594312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 271/539] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:56.599596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:56.691603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538560e-679e-4281-a6e7-cb53d446f90a None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:56.691935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538560e-679e-4281-a6e7-cb53d446f90a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:56.692157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538560e-679e-4281-a6e7-cb53d446f90a None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:56.693490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 272/540] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:56.699124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414828e5-c1b9-442b-9da3-4e25a2a9d8cc None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:56.699411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414828e5-c1b9-442b-9da3-4e25a2a9d8cc None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:56.699686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414828e5-c1b9-442b-9da3-4e25a2a9d8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:56.730238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-414828e5-c1b9-442b-9da3-4e25a2a9d8cc None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:56.731623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-414828e5-c1b9-442b-9da3-4e25a2a9d8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:56.737633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768ea7-186c-4548-8b26-0fb9064f8c8b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:56.746812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:56.785168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:56.786189 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:56.786721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:56.787215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:56.788112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:56.788678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:56.790352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:56.823892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 269/541] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:56.827836 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 273/542] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:56.831885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:56.887698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414828e5-c1b9-442b-9da3-4e25a2a9d8cc None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:56.908615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:56.992588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eb9e7-a202-48da-af12-4b0c8862489c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:57.030627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:57.034086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:57.034086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:57.034086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:57.034086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=17a501a048ed4b6c8186bfd490ad1394) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:57.034086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:57.034442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:57.040840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 270/543] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:15:56 2022] GET /identity/v3/role_assignments?user.id=17a501a048ed4b6c8186bfd490ad1394&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:57.120563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414828e5-c1b9-442b-9da3-4e25a2a9d8cc None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:57.177520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d219c-1355-418d-9860-a3e852093513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:57.178470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d219c-1355-418d-9860-a3e852093513 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:57.178897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d219c-1355-418d-9860-a3e852093513 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:57.179313 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d219c-1355-418d-9860-a3e852093513 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:57.199123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d219c-1355-418d-9860-a3e852093513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-152d219c-1355-418d-9860-a3e852093513 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:57.203797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:57.204669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:57.206014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 274/544] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:57.211577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:57.363119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b48dd-0c79-4677-8fd1-f04892794ba4 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:57.402580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:57.408393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2bd59-39b0-458f-93a6-60871c58e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:57.409835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2bd59-39b0-458f-93a6-60871c58e857 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:57.410231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2bd59-39b0-458f-93a6-60871c58e857 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:57.410509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2bd59-39b0-458f-93a6-60871c58e857 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:57.411177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2bd59-39b0-458f-93a6-60871c58e857 None admin] RBAC: Adding query filter params (name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:57.411561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2bd59-39b0-458f-93a6-60871c58e857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:57.415521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2bd59-39b0-458f-93a6-60871c58e857 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:57.425747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 271/545] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:15:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:57.430302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d219c-1355-418d-9860-a3e852093513 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:57.441764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:57.460839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a479a8-6de9-4138-8c60-d6015a326761 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:57.461147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a479a8-6de9-4138-8c60-d6015a326761 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:57.461394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a479a8-6de9-4138-8c60-d6015a326761 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:57.463812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 272/546] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:57.472192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be37e9-8ef9-4da6-aebb-63bdb084a227 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:57.472575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be37e9-8ef9-4da6-aebb-63bdb084a227 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:57.472853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be37e9-8ef9-4da6-aebb-63bdb084a227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:57.512364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-23be37e9-8ef9-4da6-aebb-63bdb084a227 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:57.513566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-23be37e9-8ef9-4da6-aebb-63bdb084a227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:57.595228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d219c-1355-418d-9860-a3e852093513 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:57.636017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 273/547] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 08 00:15:57.659067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:57.659612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:57.659891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:57.660161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:57.676652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:57.678171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:57.696085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:57.698214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:57.700285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:57.700285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:57.700285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:57.702328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be37e9-8ef9-4da6-aebb-63bdb084a227 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:57.705330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 275/548] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:57.712296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:57.812176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:57.879104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be37e9-8ef9-4da6-aebb-63bdb084a227 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:57.893477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:57.903301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b17688-1fbf-47c6-b138-604f6df5a22a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:57.945709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487dc3b-b93f-4670-bc55-4f8da6024fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:57.948027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487dc3b-b93f-4670-bc55-4f8da6024fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:57.948513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487dc3b-b93f-4670-bc55-4f8da6024fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:57.949955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487dc3b-b93f-4670-bc55-4f8da6024fc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:57.967767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:57.968706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:57.969187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:57.969657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:57.970538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:57.971115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:57.972795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:57.977294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487dc3b-b93f-4670-bc55-4f8da6024fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:57.985875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 276/549] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-e487dc3b-b93f-4670-bc55-4f8da6024fc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:57.986007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:57.991802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:57.994432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:57.996722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 274/550] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:57.999661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487dc3b-b93f-4670-bc55-4f8da6024fc0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:58.001015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:58.105666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15410251-35cf-435a-a1bf-422091dca5b7 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:58.128017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:58.141758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:58.142688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.143282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.144162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.145019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:58.145526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:58.147143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:58.156305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 277/551] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:15:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:58.162932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:58.277335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3c90-ba5b-44cd-966d-76dc51dc8720 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:58.300047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487dc3b-b93f-4670-bc55-4f8da6024fc0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:58.316220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:58.317261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.317771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.318336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.331891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:58.334322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:58.350551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:58.351544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:58.352578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:58.352578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:58.352578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:58.354841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 278/552] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:58.363094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:58.396482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:58.397203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.397372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.397643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.410638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:58.412105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:15:58.430733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:58.431704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:58.432607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 275/553] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:15:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:58.445239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:58.449958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:58.515553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:58.530014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa359aa-7968-483f-9806-acad029b0f39 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:58.568382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96374b1-e42a-436b-b82c-fc2dba14fa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:58.568994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96374b1-e42a-436b-b82c-fc2dba14fa7e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.569277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96374b1-e42a-436b-b82c-fc2dba14fa7e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.569555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96374b1-e42a-436b-b82c-fc2dba14fa7e None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.570231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96374b1-e42a-436b-b82c-fc2dba14fa7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:58.570538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96374b1-e42a-436b-b82c-fc2dba14fa7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:58.571911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96374b1-e42a-436b-b82c-fc2dba14fa7e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:58.588694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 279/554] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:58.590775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b822e9-136e-428c-9c98-930cd8a1a708 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.591132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b822e9-136e-428c-9c98-930cd8a1a708 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.591417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b822e9-136e-428c-9c98-930cd8a1a708 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.592715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 280/555] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:58.594039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b822e9-136e-428c-9c98-930cd8a1a708 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:58.609612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fd777-248e-4338-be61-245283f6d330 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:58.648867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c8ec7-5b49-48cb-8c34-1618ffd277eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:58.649535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c8ec7-5b49-48cb-8c34-1618ffd277eb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.649811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c8ec7-5b49-48cb-8c34-1618ffd277eb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.650107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c8ec7-5b49-48cb-8c34-1618ffd277eb None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.651068 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c8ec7-5b49-48cb-8c34-1618ffd277eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:58.651493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c8ec7-5b49-48cb-8c34-1618ffd277eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:58.653114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c8ec7-5b49-48cb-8c34-1618ffd277eb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:58.673390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 276/556] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 00:15:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:58.675104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50184d-8ca7-4a75-911d-a40297eeb6db None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.675396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50184d-8ca7-4a75-911d-a40297eeb6db None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.675666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50184d-8ca7-4a75-911d-a40297eeb6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.696080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3b50184d-8ca7-4a75-911d-a40297eeb6db None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:58.697378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3b50184d-8ca7-4a75-911d-a40297eeb6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:58.700640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:58.712150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b822e9-136e-428c-9c98-930cd8a1a708 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:58.748534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19181a-7ba7-41dd-96bf-f7b8aacf9d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:58.749619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19181a-7ba7-41dd-96bf-f7b8aacf9d3e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.750311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19181a-7ba7-41dd-96bf-f7b8aacf9d3e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.750793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19181a-7ba7-41dd-96bf-f7b8aacf9d3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.759421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19181a-7ba7-41dd-96bf-f7b8aacf9d3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:58.761198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19181a-7ba7-41dd-96bf-f7b8aacf9d3e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:58.773216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 277/557] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-ef19181a-7ba7-41dd-96bf-f7b8aacf9d3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:15:58.774148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:58.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:15:58.776853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:58.777789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50184d-8ca7-4a75-911d-a40297eeb6db None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:58.780010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 281/558] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:15:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:15:58.781338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d30f2-0ae4-44d5-a43e-bdd33f87c347 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.781566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d30f2-0ae4-44d5-a43e-bdd33f87c347 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.781841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d30f2-0ae4-44d5-a43e-bdd33f87c347 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.785331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 282/559] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:58.786058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d30f2-0ae4-44d5-a43e-bdd33f87c347 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:58.802547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:58.902968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d30f2-0ae4-44d5-a43e-bdd33f87c347 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:58.903438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50184d-8ca7-4a75-911d-a40297eeb6db None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:58.942461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959b70d-969e-40d1-87e6-02b8aa3e45ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:58.942759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50116f60-72b1-4fd7-a91a-c01110f3af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:58.943241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50116f60-72b1-4fd7-a91a-c01110f3af7a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.943408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959b70d-969e-40d1-87e6-02b8aa3e45ad None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.943546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50116f60-72b1-4fd7-a91a-c01110f3af7a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.943773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959b70d-969e-40d1-87e6-02b8aa3e45ad None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.943927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50116f60-72b1-4fd7-a91a-c01110f3af7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.944214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959b70d-969e-40d1-87e6-02b8aa3e45ad None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.945150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959b70d-969e-40d1-87e6-02b8aa3e45ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:58.945559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959b70d-969e-40d1-87e6-02b8aa3e45ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:58.947407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959b70d-969e-40d1-87e6-02b8aa3e45ad None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:58.974225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 283/560] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:15:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:58.974225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5455-8796-415a-986d-9107274eacd1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:58.974225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5455-8796-415a-986d-9107274eacd1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:58.974225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5455-8796-415a-986d-9107274eacd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:58.994898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6e5c5455-8796-415a-986d-9107274eacd1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:58.996126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6e5c5455-8796-415a-986d-9107274eacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:58.998496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.025085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50116f60-72b1-4fd7-a91a-c01110f3af7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.026589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50116f60-72b1-4fd7-a91a-c01110f3af7a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.042003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.082095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 284/561] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:59.082095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5455-8796-415a-986d-9107274eacd1 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.158839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 278/562] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:15:59.158839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50116f60-72b1-4fd7-a91a-c01110f3af7a None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.181932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5455-8796-415a-986d-9107274eacd1 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.217957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e828-7eaf-4db3-9ad1-7082c3f6471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.218629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e828-7eaf-4db3-9ad1-7082c3f6471f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.218906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e828-7eaf-4db3-9ad1-7082c3f6471f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.219542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e828-7eaf-4db3-9ad1-7082c3f6471f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.226441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.235284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9e828-7eaf-4db3-9ad1-7082c3f6471f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-a8e9e828-7eaf-4db3-9ad1-7082c3f6471f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:59.240681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:59.241856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:59.243021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:59.246622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 285/563] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:59.247482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e828-7eaf-4db3-9ad1-7082c3f6471f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.268562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50116f60-72b1-4fd7-a91a-c01110f3af7a None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.286587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.310164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.310808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.311085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.311354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.322319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.323774 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:59.338602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:59.339587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:59.340509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:59.340509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:59.340509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:59.340509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 279/564] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:59.340509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.353335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e828-7eaf-4db3-9ad1-7082c3f6471f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.387787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3d36-fd21-4cb7-b7e7-b07cd134ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.388407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3d36-fd21-4cb7-b7e7-b07cd134ff9c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.388694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3d36-fd21-4cb7-b7e7-b07cd134ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.388969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3d36-fd21-4cb7-b7e7-b07cd134ff9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.399148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de3d36-fd21-4cb7-b7e7-b07cd134ff9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-72de3d36-fd21-4cb7-b7e7-b07cd134ff9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:15:59.403860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:59.404778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:59.405612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 286/565] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:59.406344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3d36-fd21-4cb7-b7e7-b07cd134ff9c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.444374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c884b5a-9f85-44c4-932a-21e25a63d647 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.466445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.477523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54ff64-3c99-415c-9f70-c132680cebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.478172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54ff64-3c99-415c-9f70-c132680cebb8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.478455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54ff64-3c99-415c-9f70-c132680cebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.478730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54ff64-3c99-415c-9f70-c132680cebb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.489526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54ff64-3c99-415c-9f70-c132680cebb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.491002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54ff64-3c99-415c-9f70-c132680cebb8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-2a54ff64-3c99-415c-9f70-c132680cebb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:59.505224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:59.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:59.507100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:59.507100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:59.507100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:15:59.507100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 280/566] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:59.507560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e13704-a849-4a84-89ed-ae3164c83350 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.507649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3d36-fd21-4cb7-b7e7-b07cd134ff9c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.507723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e13704-a849-4a84-89ed-ae3164c83350 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.507982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e13704-a849-4a84-89ed-ae3164c83350 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.509212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 281/567] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:15:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:15:59.509895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e13704-a849-4a84-89ed-ae3164c83350 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.535293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.545909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.546544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.546823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.547090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.547953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:59.548253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.550187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.562745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 287/568] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:59.562745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.624652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e13704-a849-4a84-89ed-ae3164c83350 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.658195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341853c1-fbdf-476a-abbc-e96d97b4caad None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.658860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.659398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.659675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.659942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.660572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:59.661503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.662247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.673005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 282/569] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:59.673771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.678822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.692957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a43ed-f10d-4b75-9c30-1a523303ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.693554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a43ed-f10d-4b75-9c30-1a523303ad79 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.693910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a43ed-f10d-4b75-9c30-1a523303ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.694216 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a43ed-f10d-4b75-9c30-1a523303ad79 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.694861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a43ed-f10d-4b75-9c30-1a523303ad79 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:59.695160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a43ed-f10d-4b75-9c30-1a523303ad79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.696493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a43ed-f10d-4b75-9c30-1a523303ad79 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.704220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 288/570] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:59.705538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e381-19ac-435c-ad84-9dc2a70c9c58 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.705967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e381-19ac-435c-ad84-9dc2a70c9c58 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.706421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e381-19ac-435c-ad84-9dc2a70c9c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.724164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-5066e381-19ac-435c-ad84-9dc2a70c9c58 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:15:59.725339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5066e381-19ac-435c-ad84-9dc2a70c9c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:15:59.755482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.779694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78910a-83ee-4780-a7f1-0ce5cd07141e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.791174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 289/571] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:15:59.791999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066e381-19ac-435c-ad84-9dc2a70c9c58 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.822237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.822772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.823054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.823331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.823974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:15:59.824280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.825649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.838077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 283/572] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:15:59.838930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.903632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066e381-19ac-435c-ad84-9dc2a70c9c58 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.916990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:15:59.937918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.938577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.938855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.939121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.948683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.950104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feac742-9f0f-445e-bee9-4cb5af6979c2 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:15:59.950211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:15:59.963976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:15:59.964918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:15:59.965786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:15:59.965786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:15:59.965786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:15:59.965786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 290/573] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:15:59.965786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:15:59.987251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:15:59.987873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:15:59.988151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:15:59.988418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:15:59.995077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:15:59.996524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:15:59.998234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:00.009436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:00.010369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 284/574] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:00.016106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.066127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288a271-1492-4e84-af68-7ddbf1e41479 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.099154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.099699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.100058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.100332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.110589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.112045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.114454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3ccfa-cfc5-4528-8d94-8e228d1e0367 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:00.125757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:00.126827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:00.127706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:00.127706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:00.127706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:00.127706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 291/575] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:00.127706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.148985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.149136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905df4f-58e3-4209-bd10-5b3c3990d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.149698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905df4f-58e3-4209-bd10-5b3c3990d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.149985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905df4f-58e3-4209-bd10-5b3c3990d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.150284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905df4f-58e3-4209-bd10-5b3c3990d4a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.160828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905df4f-58e3-4209-bd10-5b3c3990d4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7905df4f-58e3-4209-bd10-5b3c3990d4a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:00.165862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:00.166841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:00.167682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 285/576] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:00.168373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905df4f-58e3-4209-bd10-5b3c3990d4a6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.232538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.239087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67942045-3b26-4cfa-891e-d4f212b11a90 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.272218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.272829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.273106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.273378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.276006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905df4f-58e3-4209-bd10-5b3c3990d4a6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.281121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.282598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:00.294417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:00.295288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 292/577] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:00.296465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.311469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.312072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.312350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.312620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.313251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:00.313554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.315487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.326769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 286/578] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:00.327537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.378338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.401983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987805d-e047-42df-a842-a2f689479f24 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.427173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb89ea-48ba-47b9-93ad-f51672cd1694 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.435503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.436101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.436381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.436652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.437335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:00.437638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.439085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.443551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.450979 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 293/579] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:00.451775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.461904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.462898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.463182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.463459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.464105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:00.464411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.465769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.478773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 287/580] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:00.479575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.552416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b84d-a339-4187-8287-dbe4dfe43198 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.578700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95365b6-26cb-416c-b2d4-71c89e878a7c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.585290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.585885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.586195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.586468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.587119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:00.587420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.588771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.590888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.597796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 294/581] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:00.599078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.612845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.613436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.613713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.613982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.614690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:00.614996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.616412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.627948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 288/582] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:00.628779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.668730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.701347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009f58b-d49d-4f87-937e-0a709b9e7816 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.728920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255323b8-a332-4934-9794-82ad13c3545f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.734715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.735363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.735646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.735919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.743730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.745142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:00.756368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:00.757453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 00:16:00.758624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:00.762160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 295/583] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:00.762969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.763595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87876cd0-06a5-432e-be57-1979539b8fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.764245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87876cd0-06a5-432e-be57-1979539b8fb3 None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.764524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87876cd0-06a5-432e-be57-1979539b8fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.764795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87876cd0-06a5-432e-be57-1979539b8fb3 None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/fe6573439abd4afb8098390eb4c7e5ef/roles/db558e2340b04e8194fea3fe2b17b159` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.779005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87876cd0-06a5-432e-be57-1979539b8fb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=fe6573439abd4afb8098390eb4c7e5ef, role_id=db558e2340b04e8194fea3fe2b17b159)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.780466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87876cd0-06a5-432e-be57-1979539b8fb3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.793753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 289/584] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:00 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/fe6573439abd4afb8098390eb4c7e5ef/roles/db558e2340b04e8194fea3fe2b17b159 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:00.794655 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87876cd0-06a5-432e-be57-1979539b8fb3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.827162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.884596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b5d2-bee0-42b4-820f-7b0008a5f84b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.895814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:00.911138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87876cd0-06a5-432e-be57-1979539b8fb3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:00.923135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.923872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.924676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.924945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.933551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.935047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:00.947780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:00.948858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:00.949789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 296/585] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:00.950416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:00.961060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:00.961704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:00.961986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:00.962284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:00.973375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:00.974909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:00.990485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:00.991471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:00.992344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:00.992344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:00.992344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:00.992344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 290/586] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:00.992891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.056523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4eb4-33d8-4279-9c55-b48e9bf8c3ac None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.074167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:01.091999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.092604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.092884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.093164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.093877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=faeb9592d8fd4906a1298e7e550c1e1f) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:01.094280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.095753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.099605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c6ed-002a-4c54-9f7d-c447d8518eb6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.110096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 297/587] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/role_assignments?user.id=faeb9592d8fd4906a1298e7e550c1e1f&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:01.110096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.155676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.156299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.156673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.157015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.157831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:01.158241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.160950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.175263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:01.188992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 291/588] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 00:16:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:01.190255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.237902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a5043-c712-4ae7-a330-6ac219e6e7b9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.279740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.280467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.280855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.281203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.282129 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:01.282511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.284197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.304764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 298/589] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:01.305784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.337426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd72b-9708-44e7-a393-3054a861d690 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.358201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:01.382635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.383478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.383478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.383765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.384407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:01.384711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.386312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.399420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 292/590] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:01.400477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.435055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628510-0be4-459e-9e5b-192537679ae2 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.473522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.474389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.474606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.474890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.478995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:01.489352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.491065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:01.507310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:01.508292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:01.509169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:01.509169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:01.509169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:01.513132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 299/591] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:01.513940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.536528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482b243-d09f-40ac-b8e5-929d250e758f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.582393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.583641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.584528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.585278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.599848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.602161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.619575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:01.627601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:01.628552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:01.629443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:01.629443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:01.629443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:01.631240 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 293/592] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:01.632166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.632410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70b7d-6dda-4179-b625-2eee3ea1644c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.669629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.670652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.670937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.671312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.680671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.682248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:01.695097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:01.696234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 00:16:01.697371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:01.699456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 300/593] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:01.700490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.756003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47f38-052e-4081-ab73-1af9b1e00950 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.767535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:01.794174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.795418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.795418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.795723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.796510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:01.796913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.798415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.811725 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 294/594] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:01.817503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.833849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f394d25-685c-4e9f-b422-444ac3edfe2c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.888111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.889242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.889684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.890472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.891519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:01.891992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.894081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:01.912044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 301/595] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:01.913334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:01.935699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:01.938784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553c5b-61cc-44b1-af63-39279c9b689d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:01.975863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:01.976474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:01.976751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:01.977021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:01.977794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:01.978126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:01.979656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.002360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 295/596] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:02.003233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.033086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:02.053267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717cbc9-99a9-41d3-97ce-ab87c67dfb50 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.097281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.098566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.099050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.099645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.108715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.109160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e058e-17bd-437d-a646-2bb9194f8dc6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.110593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:02.125737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:02.126793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:02.127815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:02.127815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:02.127815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:02.127815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:02.127815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:02.127815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:02.127815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:02.127815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:02.130193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 302/597] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:02.131134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.152683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.153975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.154431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.154850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.165150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.167726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:02.182310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:02.183391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:02.184479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:02.184479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:02.184479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:02.184479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:02.184479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:02.184479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:02.184479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:02.184479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:02.187306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 296/598] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:02.188537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.212400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:02.250663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894cd01-6748-49c6-820d-a6ebabf87e5e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.291303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.291940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.292223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.292527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.304978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.306620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.320079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:02.323794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:02.325139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:02.326197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:02.326197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:02.326197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:02.326197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 303/599] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:02.326197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.340294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac13776-69a1-450c-9231-2844993dab6a None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.378608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.379877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.380582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.381018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.382150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:02.382621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.384920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.401683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 297/600] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:02.402812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.443493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1c139-7a5f-4f09-aa4c-08c9c0427930 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.469247 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:02.482820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.483487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.483819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.484200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.484892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:02.485379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.487353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.506778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 304/601] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:02.507199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.540226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f85b9-bd7b-462b-be8a-a156d07c165d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.587354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.588485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.588917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.590195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.590997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:02.591453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.592975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.610232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 298/602] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:02.611603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.622826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612eeba-8a2a-46bb-b70b-ddfc8e054699 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.626881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:02.663003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208e410-8684-49f1-8166-21423659a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.663666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208e410-8684-49f1-8166-21423659a228 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.663949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208e410-8684-49f1-8166-21423659a228 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.664227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208e410-8684-49f1-8166-21423659a228 None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/064dcac38bd1416f93bb1b763cb89f84/roles/db558e2340b04e8194fea3fe2b17b159` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.680536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208e410-8684-49f1-8166-21423659a228 None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=064dcac38bd1416f93bb1b763cb89f84, role_id=db558e2340b04e8194fea3fe2b17b159)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.682169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208e410-8684-49f1-8166-21423659a228 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.698694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 305/603] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:02 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/064dcac38bd1416f93bb1b763cb89f84/roles/db558e2340b04e8194fea3fe2b17b159 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:02.700095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208e410-8684-49f1-8166-21423659a228 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.738411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c4dee-9807-496f-8249-8b9300d413be None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.740910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:02.781239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28191abc-2394-4a2e-8e89-43f81ef7b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.782289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28191abc-2394-4a2e-8e89-43f81ef7b1f8 None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.782751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28191abc-2394-4a2e-8e89-43f81ef7b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.783267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28191abc-2394-4a2e-8e89-43f81ef7b1f8 None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/b1d5fb05964b47d5a2f33fe9dde1f65f/roles/db558e2340b04e8194fea3fe2b17b159` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.801458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28191abc-2394-4a2e-8e89-43f81ef7b1f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=b1d5fb05964b47d5a2f33fe9dde1f65f, role_id=db558e2340b04e8194fea3fe2b17b159)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.803444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28191abc-2394-4a2e-8e89-43f81ef7b1f8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.825775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 299/604] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:02 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/b1d5fb05964b47d5a2f33fe9dde1f65f/roles/db558e2340b04e8194fea3fe2b17b159 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:02.826036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208e410-8684-49f1-8166-21423659a228 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:02.916032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:02.916698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.916980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.917255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.928260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:02.929738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:02.935985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4c61-4da8-4363-bd53-ff53eedf1e60 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.936683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4c61-4da8-4363-bd53-ff53eedf1e60 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.937162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4c61-4da8-4363-bd53-ff53eedf1e60 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.940815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 300/605] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:02.945714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada247-26f6-4324-9178-7c34b5b6374d None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:02.946323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada247-26f6-4324-9178-7c34b5b6374d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:02.946805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada247-26f6-4324-9178-7c34b5b6374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:02.948232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:02.949115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:02.950539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 306/606] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:02.955004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:02.971841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-48ada247-26f6-4324-9178-7c34b5b6374d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:02.973432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-48ada247-26f6-4324-9178-7c34b5b6374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:03.074016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:03.078697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:03.089531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9935ae-bf2b-4e61-9d3c-40bb8170b756 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:03.098176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 301/607] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:16:03.120926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada247-26f6-4324-9178-7c34b5b6374d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:03.130534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:03.131342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.131764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.132284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.133211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:03.133657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:03.135411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:03.150318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 307/608] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:03.156480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:03.254597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada247-26f6-4324-9178-7c34b5b6374d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:03.274318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8359094-c6b9-44d6-be14-ce340e78d270 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:03.294188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd61bd5-2d7d-4e14-8f1b-1ee7638b106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:03.295164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61bd5-2d7d-4e14-8f1b-1ee7638b106e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.295613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61bd5-2d7d-4e14-8f1b-1ee7638b106e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.296074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61bd5-2d7d-4e14-8f1b-1ee7638b106e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.308918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd61bd5-2d7d-4e14-8f1b-1ee7638b106e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7fd61bd5-2d7d-4e14-8f1b-1ee7638b106e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:03.313932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:03.315632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:03.316544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 302/609] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:03.317244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecaf09-1637-4adc-a116-3a409daf6bb0 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.317351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecaf09-1637-4adc-a116-3a409daf6bb0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.317622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecaf09-1637-4adc-a116-3a409daf6bb0 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.319091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 303/610] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:03.323180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecaf09-1637-4adc-a116-3a409daf6bb0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:03.324960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cd66e-d689-47c6-874e-e53ffeda3677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:03.325810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd66e-d689-47c6-874e-e53ffeda3677 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.326348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd66e-d689-47c6-874e-e53ffeda3677 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.326773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd66e-d689-47c6-874e-e53ffeda3677 None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/17a501a048ed4b6c8186bfd490ad1394/roles/db558e2340b04e8194fea3fe2b17b159` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.346907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cd66e-d689-47c6-874e-e53ffeda3677 None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=17a501a048ed4b6c8186bfd490ad1394, role_id=db558e2340b04e8194fea3fe2b17b159)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:03.349260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cd66e-d689-47c6-874e-e53ffeda3677 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:03.373198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 308/611] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:03 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/17a501a048ed4b6c8186bfd490ad1394/roles/db558e2340b04e8194fea3fe2b17b159 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:03.375205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660821-82d3-4e84-a5c9-670a0affbedf None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.375688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660821-82d3-4e84-a5c9-670a0affbedf None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.376132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660821-82d3-4e84-a5c9-670a0affbedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.386007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:03.400534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d9660821-82d3-4e84-a5c9-670a0affbedf None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:03.401589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:03.404066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d9660821-82d3-4e84-a5c9-670a0affbedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:03.485850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 309/612] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:03.519083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecaf09-1637-4adc-a116-3a409daf6bb0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:03.524695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9660821-82d3-4e84-a5c9-670a0affbedf None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:03.575304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:03.576508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.576943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.577377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.578226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:03.578681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:03.580940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:03.590718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 304/613] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:03.598205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:03.643354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9660821-82d3-4e84-a5c9-670a0affbedf None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:03.685492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0994e-4878-448d-b885-42fe9a0e1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:03.686712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0994e-4878-448d-b885-42fe9a0e1156 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.687146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0994e-4878-448d-b885-42fe9a0e1156 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.687587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0994e-4878-448d-b885-42fe9a0e1156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.691303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:03.710703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0994e-4878-448d-b885-42fe9a0e1156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-8ff0994e-4878-448d-b885-42fe9a0e1156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:03.717480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:03.718467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:03.719288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:03.722482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 310/614] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:03.731121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0994e-4878-448d-b885-42fe9a0e1156 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:03.754973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f3303-efcd-4ec7-a5b0-86148071bda3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:03.772801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:03.818783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:03.819425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.819704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.819975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.838252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:03.839639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:03.863267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:03.864207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:03.865074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:03.865074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:03.865074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:03.869400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 305/615] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:03.874980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:03.929421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0994e-4878-448d-b885-42fe9a0e1156 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:03.994443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:03.995411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:03.995893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:03.996500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:03.997396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:04.002683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:04.004405 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:04.020909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 311/616] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:04.025976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:04.064711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28602d-d879-4ab6-848f-25ef226620c6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:04.115741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:04.134198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:04.135998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:04.136483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:04.137141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:04.139201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:04.139716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:04.141293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:04.166097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 306/617] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:04.171959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:04.198198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404043ce-eff7-437d-8c70-18c08a5d8cf9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:04.210685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:04.279485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:04.280116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:04.280391 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:04.280658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:04.304972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3577a-d627-42f2-8336-639c8f4b7d07 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:04.308940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:04.310437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:04.338963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:04.340060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:04.341609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:04.341609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:04.341609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:04.341609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 312/618] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:04.342798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:04.343431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:04.343714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:04.343991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:04.346960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:04.352639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:04.354109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:04.368028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:04.368947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:04.371177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 307/619] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:16:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:04.376161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:04.499530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:04.544792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0f6d0-683e-4e63-91a6-5a268b3574c5 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:04.566519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:04.567992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d7825-61b4-4d7e-99bd-5f54965ab3ef None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:04.599713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:04.600319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:04.600599 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:04.600870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:04.601504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:04.601805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:04.603194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:04.620598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 313/620] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:04.627592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:04.638835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:04.639474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:04.639709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:04.639983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:04.640719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:04.641023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:04.643014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:04.672205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 308/621] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:16:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:04.677684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:04.809197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2de59-ea72-4528-859f-7627e879b67f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:04.867914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b556ea-e56a-410d-84eb-760f877b9bc1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:04.870464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:04.871158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:04.871386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:04.871659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:04.886631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:04.888089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:04.908392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:04.910782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:04.913109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 314/622] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:04.917460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:04.942989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc5c5-1df3-4322-ae21-d12835530b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:04.943599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc5c5-1df3-4322-ae21-d12835530b19 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:04.943879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc5c5-1df3-4322-ae21-d12835530b19 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:04.944150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc5c5-1df3-4322-ae21-d12835530b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:04.979070 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:04.984618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:05.031494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fc5c5-1df3-4322-ae21-d12835530b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:05.033307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fc5c5-1df3-4322-ae21-d12835530b19 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:05.137672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 309/623] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 00:16:05.139305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654eee-25fe-4b12-8d3b-33a3f69967ab None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.139770 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654eee-25fe-4b12-8d3b-33a3f69967ab None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.140195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654eee-25fe-4b12-8d3b-33a3f69967ab None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.141841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 310/624] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:05.144583 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654eee-25fe-4b12-8d3b-33a3f69967ab None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.156362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f358de-aa88-406b-926e-ce9bafe1d384 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:05.190384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:05.206623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baac905-d6c3-405c-99db-820aa4aee0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:05.208280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac905-d6c3-405c-99db-820aa4aee0b6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.208833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac905-d6c3-405c-99db-820aa4aee0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.209572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac905-d6c3-405c-99db-820aa4aee0b6 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.211181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baac905-d6c3-405c-99db-820aa4aee0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:05.211805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baac905-d6c3-405c-99db-820aa4aee0b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:05.214323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baac905-d6c3-405c-99db-820aa4aee0b6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:05.238205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 315/625] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 00:16:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:05.239814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9fc0-af0d-4f66-8cbb-e4718ec52f66 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.240316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9fc0-af0d-4f66-8cbb-e4718ec52f66 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.240791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9fc0-af0d-4f66-8cbb-e4718ec52f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.266457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-362a9fc0-af0d-4f66-8cbb-e4718ec52f66 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:05.266647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654eee-25fe-4b12-8d3b-33a3f69967ab None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:05.267695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-362a9fc0-af0d-4f66-8cbb-e4718ec52f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:05.309635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:05.310307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.310645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.310855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.323109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:05.324598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:05.339363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:05.340338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:05.341947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:05.341947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:05.341947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:05.341947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 311/626] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:05.350414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 316/627] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:05.350414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa55a3-a8a3-44a9-bf54-164298595f9c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.350414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa55a3-a8a3-44a9-bf54-164298595f9c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.350414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa55a3-a8a3-44a9-bf54-164298595f9c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.350740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.350823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 317/628] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:05.350823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa55a3-a8a3-44a9-bf54-164298595f9c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.368397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:05.459237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:05.459485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa55a3-a8a3-44a9-bf54-164298595f9c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:05.469193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd490c-bb8d-4c67-a11d-626ff976f26f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:05.496779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a71a5-123f-4439-942a-5ac206cba101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:05.497389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a71a5-123f-4439-942a-5ac206cba101 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.497669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a71a5-123f-4439-942a-5ac206cba101 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.497945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a71a5-123f-4439-942a-5ac206cba101 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.498611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a71a5-123f-4439-942a-5ac206cba101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:05.498915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a71a5-123f-4439-942a-5ac206cba101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:05.500359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a71a5-123f-4439-942a-5ac206cba101 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:05.507043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:05.507689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.507947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.508217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.512584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 318/629] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:05.513691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32999c-3f75-461e-bbe5-9b42cd5e97d7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.513976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32999c-3f75-461e-bbe5-9b42cd5e97d7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.514277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32999c-3f75-461e-bbe5-9b42cd5e97d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.524485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:05.525941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:05.532293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-be32999c-3f75-461e-bbe5-9b42cd5e97d7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:05.533504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-be32999c-3f75-461e-bbe5-9b42cd5e97d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:05.541788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:05.542884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:05.544138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:05.544138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:05.544138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:05.544138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 312/630] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:05.544601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.616188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 319/631] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:05.623068 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32999c-3f75-461e-bbe5-9b42cd5e97d7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.633701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:05.655535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7375f8-0f01-456e-842b-2e83f4649968 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:05.693426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe31f5-5884-452b-9bfb-b88ac454726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:05.694107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe31f5-5884-452b-9bfb-b88ac454726c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.694368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe31f5-5884-452b-9bfb-b88ac454726c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.694644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe31f5-5884-452b-9bfb-b88ac454726c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.706804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe31f5-5884-452b-9bfb-b88ac454726c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-e9fe31f5-5884-452b-9bfb-b88ac454726c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:05.712207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:05.713094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:05.713911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:05.720446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 313/632] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:05.722164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe31f5-5884-452b-9bfb-b88ac454726c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.726769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:05.740562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32999c-3f75-461e-bbe5-9b42cd5e97d7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:05.775150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:05.775784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.776066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.776340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.783614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:05.785053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:05.796203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:05.797082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:05.797984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 320/633] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:05.799521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.840253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe31f5-5884-452b-9bfb-b88ac454726c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:05.868719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:05.875948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:05.876557 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.876839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.877320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.878313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:05.878623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:05.880003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:05.893897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 314/634] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:05.895255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.906651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499f3a-c9c3-4939-a685-2146d9744b36 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:05.941778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441caff5-9d62-47f0-8df6-da19a027c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:05.942521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441caff5-9d62-47f0-8df6-da19a027c212 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:05.942803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441caff5-9d62-47f0-8df6-da19a027c212 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:05.943077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441caff5-9d62-47f0-8df6-da19a027c212 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:05.952943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441caff5-9d62-47f0-8df6-da19a027c212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:05.955726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-441caff5-9d62-47f0-8df6-da19a027c212 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:05.957787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:05.958925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:05.959941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:05.963939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 321/635] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:05.964581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441caff5-9d62-47f0-8df6-da19a027c212 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:05.995516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67917-589f-4d09-b09c-16aa10fd3545 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.029344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885bd4-f06f-425b-a300-85b1aa8cac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.030031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885bd4-f06f-425b-a300-85b1aa8cac9e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.030348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885bd4-f06f-425b-a300-85b1aa8cac9e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.030617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885bd4-f06f-425b-a300-85b1aa8cac9e None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.031272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885bd4-f06f-425b-a300-85b1aa8cac9e None admin] RBAC: Adding query filter params (name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:06.031568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885bd4-f06f-425b-a300-85b1aa8cac9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.032928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885bd4-f06f-425b-a300-85b1aa8cac9e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.041355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 315/636] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:06.042354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc739ab-4644-472b-899c-57c444fc71cb None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.042633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc739ab-4644-472b-899c-57c444fc71cb None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.042903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc739ab-4644-472b-899c-57c444fc71cb None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.044215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 316/637] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:06.046836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc739ab-4644-472b-899c-57c444fc71cb None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.066022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441caff5-9d62-47f0-8df6-da19a027c212 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.090800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:06.100306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.100919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.101201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.101475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.102192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:06.102503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.103919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.115636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 322/638] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:06.116419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.148090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc739ab-4644-472b-899c-57c444fc71cb None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.174559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:06.183822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.184435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.184710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.184985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.191401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.192815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:06.203684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:06.204637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 317/639] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:06.206083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.216308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fc568-12e1-447d-9aa5-a25d2011369c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.251510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a79a4-d162-4250-a586-10e239f25350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.252154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a79a4-d162-4250-a586-10e239f25350 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.252435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a79a4-d162-4250-a586-10e239f25350 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.252703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a79a4-d162-4250-a586-10e239f25350 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.253354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a79a4-d162-4250-a586-10e239f25350 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:06.253654 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a79a4-d162-4250-a586-10e239f25350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.255046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a79a4-d162-4250-a586-10e239f25350 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.262789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 323/640] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:06.263916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb51a-e378-48f5-9061-cca45314c3ee None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.264257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb51a-e378-48f5-9061-cca45314c3ee None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.264539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb51a-e378-48f5-9061-cca45314c3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.282218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-3f6fb51a-e378-48f5-9061-cca45314c3ee None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:06.283939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3f6fb51a-e378-48f5-9061-cca45314c3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:06.306296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d57c2-9088-440d-b8ba-872951245542 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.326208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:06.339132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.339755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.340032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.340304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.350634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.351752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 324/641] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:06.352058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.352600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fb51a-e378-48f5-9061-cca45314c3ee None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:06.366469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:06.367480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:06.368379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:06.368379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:06.368379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:06.368379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 318/642] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:06.368379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.413095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:06.452558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fb51a-e378-48f5-9061-cca45314c3ee None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.473270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b274f84-8bcc-4173-8284-1d51250ddc4b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.486428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.487058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.487339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.487614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.488327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=fe6573439abd4afb8098390eb4c7e5ef) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:06.488637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.490077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.495885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 325/643] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/role_assignments?user.id=fe6573439abd4afb8098390eb4c7e5ef&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:06.496664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.508423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.509048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.509330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.509606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.510351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:06.510664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.512152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.526854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 319/644] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:06.527732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.552868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:06.619768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155df27d-9c77-4caf-8a1b-74d2bf3a1773 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.642232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:06.648022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58202d5b-5f7b-439b-8e32-8d0309318c2c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.664372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.665004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.665285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.665559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.677821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.679508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.690584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.691466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.691466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.691726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.692768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:06.692768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.694018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:06.694356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:06.695468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:06.696502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:06.696502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:06.696502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:06.696502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 326/645] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:06.696751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.708807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 320/646] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:06.708807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.799429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:06.807245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757a70f-e421-47db-8ba8-69cf494b5a1f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.820939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91035f8c-9656-46ee-86b3-43c7b06efb50 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.845091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf653df-57fb-4d2c-9141-d13266a6e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.845749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf653df-57fb-4d2c-9141-d13266a6e24a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.846026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf653df-57fb-4d2c-9141-d13266a6e24a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.846344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf653df-57fb-4d2c-9141-d13266a6e24a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.860589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e535a75-2b1e-464f-a0e2-638bc5c91feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:06.861778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e535a75-2b1e-464f-a0e2-638bc5c91feb None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:06.862083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e535a75-2b1e-464f-a0e2-638bc5c91feb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:06.862364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e535a75-2b1e-464f-a0e2-638bc5c91feb None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/faeb9592d8fd4906a1298e7e550c1e1f/roles/db558e2340b04e8194fea3fe2b17b159` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:06.863358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf653df-57fb-4d2c-9141-d13266a6e24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-bcf653df-57fb-4d2c-9141-d13266a6e24a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:06.868735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:06.870459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 327/647] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:06.871669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf653df-57fb-4d2c-9141-d13266a6e24a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:06.982146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf653df-57fb-4d2c-9141-d13266a6e24a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:06.996815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e535a75-2b1e-464f-a0e2-638bc5c91feb None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=faeb9592d8fd4906a1298e7e550c1e1f, role_id=db558e2340b04e8194fea3fe2b17b159)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:06.998289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e535a75-2b1e-464f-a0e2-638bc5c91feb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.022095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 321/648] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:06 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/faeb9592d8fd4906a1298e7e550c1e1f/roles/db558e2340b04e8194fea3fe2b17b159 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:07.022095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e535a75-2b1e-464f-a0e2-638bc5c91feb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.028969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.029730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.030031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.030335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.030993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:07.031355 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.032793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.033846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:07.054362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 328/649] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:07.055286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.080040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:07.170140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e535a75-2b1e-464f-a0e2-638bc5c91feb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.195325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f6616-09c9-45d3-a6d5-3b0c751c63a1 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.210375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.211423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.211774 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.212054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.221923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.223492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.241132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:07.241946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:07.243010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 00:16:07.244005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:07.244566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 322/650] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:07.245131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.245588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.246100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.246766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.248017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:07.249634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.251311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.266253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 329/651] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:07.267961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.325345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:07.360883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:07.362886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a9c6-0b74-47f9-acf2-aeb4b0e4eff0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.386502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ee181-2596-4708-ab78-62133379a5aa None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.398398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.399333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.400017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.400524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.408550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.410268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.422479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:07.422891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:07.424475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 00:16:07.425484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:07.426019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.426019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.426019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.426019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:07.426019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.426989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.428726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 323/652] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:07.435467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.451358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 330/653] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:07.452266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.540905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1396f2-a6d1-4823-a8e3-8343f9d0a2b5 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.559923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42dee-0d79-4225-8aa6-6de35eae20f6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.576759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.577722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.578257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.578752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.582454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:07.594701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.596265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.596864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.597175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.597416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.597990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.598195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:07.598465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.599893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.601768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:07.619119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:07.620171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:07.621050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:07.621050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:07.621050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:07.629094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 324/655] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:07.630146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 331/655] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:07.630538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.631150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.748329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cab161-323e-4f28-8aae-db2649c7f805 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.771024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e797-859e-427c-9b24-716b7f02127b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.787720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.788133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.788413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.788687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.789321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:07.789703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.791016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.807063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 332/656] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:07.807063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:07.825213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b06a1e-dc41-4591-b298-0c642242a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.826218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06a1e-dc41-4591-b298-0c642242a5ca None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.826726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06a1e-dc41-4591-b298-0c642242a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.827460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06a1e-dc41-4591-b298-0c642242a5ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:07.875935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:07.895028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:07.916727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b06a1e-dc41-4591-b298-0c642242a5ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:07.918472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b06a1e-dc41-4591-b298-0c642242a5ca None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:07.939056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26162-1b3b-4fb7-9f4f-fbb780133137 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:07.982339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3dc78-590c-45bc-a666-51a3faa4e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:07.983535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3dc78-590c-45bc-a666-51a3faa4e4bf None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:07.984211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3dc78-590c-45bc-a666-51a3faa4e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:07.984644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3dc78-590c-45bc-a666-51a3faa4e4bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.026296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 325/657] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:16:08.027358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b06a1e-dc41-4591-b298-0c642242a5ca None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.073881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3dc78-590c-45bc-a666-51a3faa4e4bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.075797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3dc78-590c-45bc-a666-51a3faa4e4bf None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.112418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:08.134777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b06a1e-dc41-4591-b298-0c642242a5ca None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:08.142341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:08.178503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:08.179256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.179542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.179816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.190105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.192262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:08.207635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:08.208720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 00:16:08.209652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:08.210389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 333/658] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:16:08.211414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3dc78-590c-45bc-a666-51a3faa4e4bf None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.213232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 326/659] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:08.214131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.323024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3dc78-590c-45bc-a666-51a3faa4e4bf None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:08.340078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260e79c-183f-4815-9ba8-085efc3b0d00 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:08.359734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:08.360591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.361547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.361987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.373080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.375078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.377143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:08.377736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.378101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.378450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.388737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.390302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:08.393360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:08.394560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:08.395457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:08.395457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:08.395457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:08.395627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:08.397629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 334/660] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:08.398718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.403059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:08.407328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:08.408503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:08.409811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:08.409811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:08.409811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:08.413681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 327/661] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:08.414795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.511399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43593739-c68e-4faa-8cd7-33962d4aef5d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:08.525572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c684c-8f35-4076-b01a-15a232dbbd0c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:08.547789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:08.549327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.549815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.550334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.551271 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:08.551835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.553475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.561255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:08.561845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.562160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.562444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.563138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:08.563448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.565553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.575789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 335/662] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:08.577073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.582817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 328/663] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:08.583767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.639034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:08.642789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:08.686795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d51a15-5f3c-4496-9e0d-f93999df93d3 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:08.690458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dea59-8ac9-4ab9-ba5b-4e29119f14dd None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:08.722356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:08.722956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.723233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.723500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.724126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:08.724423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.725761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.726435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f11119-2efe-4134-acae-d49a6eff000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:08.727144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11119-2efe-4134-acae-d49a6eff000d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.727430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11119-2efe-4134-acae-d49a6eff000d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.727702 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11119-2efe-4134-acae-d49a6eff000d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.741724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 336/664] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:08.741724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.804287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f11119-2efe-4134-acae-d49a6eff000d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.805860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f11119-2efe-4134-acae-d49a6eff000d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.854282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d3931-2c11-4afb-adbb-baca6d60edc6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:08.865628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:08.878548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:08.890901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296da8d7-ee1e-4a82-abeb-5fa396c229c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:08.891460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8d7-ee1e-4a82-abeb-5fa396c229c6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.891731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8d7-ee1e-4a82-abeb-5fa396c229c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.892004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8d7-ee1e-4a82-abeb-5fa396c229c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.900004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296da8d7-ee1e-4a82-abeb-5fa396c229c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:08.901419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296da8d7-ee1e-4a82-abeb-5fa396c229c6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-296da8d7-ee1e-4a82-abeb-5fa396c229c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:08.912362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:08.913269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:08.914184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 337/665] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:08.914695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd53c-b060-4104-9c14-459fb562bc6c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:08.915536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd53c-b060-4104-9c14-459fb562bc6c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:08.915536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd53c-b060-4104-9c14-459fb562bc6c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:08.916535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 338/666] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:08.921156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcd53c-b060-4104-9c14-459fb562bc6c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:08.929767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 329/667] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:16:08.929767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f11119-2efe-4134-acae-d49a6eff000d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.032253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f11119-2efe-4134-acae-d49a6eff000d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.035918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcd53c-b060-4104-9c14-459fb562bc6c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.068457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c13ba-b718-4bfa-8032-2ebef790f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.069059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c13ba-b718-4bfa-8032-2ebef790f372 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.069344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c13ba-b718-4bfa-8032-2ebef790f372 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.069620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c13ba-b718-4bfa-8032-2ebef790f372 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.070336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c13ba-b718-4bfa-8032-2ebef790f372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:09.070637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c13ba-b718-4bfa-8032-2ebef790f372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:09.072065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c13ba-b718-4bfa-8032-2ebef790f372 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:09.079828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.080453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.081277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.081559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.088947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 330/668] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:09.088947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da252b-2560-4278-a2aa-7ae62342630e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.088947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da252b-2560-4278-a2aa-7ae62342630e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.088947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da252b-2560-4278-a2aa-7ae62342630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.095472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:09.097235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:09.103719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-55da252b-2560-4278-a2aa-7ae62342630e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:09.104919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-55da252b-2560-4278-a2aa-7ae62342630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:09.109189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:09.110242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:09.111845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 339/669] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:09.112451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.113706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:09.155228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:09.182151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 331/670] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:09.182151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da252b-2560-4278-a2aa-7ae62342630e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.212681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35f5eb-b5e6-4efb-8e05-bbd51cb17372 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.246276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577639-af59-497d-b36a-4b2644afcced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.247275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577639-af59-497d-b36a-4b2644afcced None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.247551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577639-af59-497d-b36a-4b2644afcced None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.247820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577639-af59-497d-b36a-4b2644afcced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.260079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577639-af59-497d-b36a-4b2644afcced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:09.261516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577639-af59-497d-b36a-4b2644afcced None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:09.270889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da252b-2560-4278-a2aa-7ae62342630e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-f4577639-af59-497d-b36a-4b2644afcced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:09.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:09.276820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:09.277797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:09.277797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:09.277797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:09.277797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 340/671] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:09.278032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b975-5204-4a5d-a238-d5c44132cb81 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.278225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b975-5204-4a5d-a238-d5c44132cb81 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.278496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b975-5204-4a5d-a238-d5c44132cb81 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.279729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 341/672] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:09.280417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166b975-5204-4a5d-a238-d5c44132cb81 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.308023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.308620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.308895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.309167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.309886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=064dcac38bd1416f93bb1b763cb89f84) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:09.310234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:09.311650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:09.317291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 332/673] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/role_assignments?user.id=064dcac38bd1416f93bb1b763cb89f84&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:09.318104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.326707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:09.384338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:09.394482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166b975-5204-4a5d-a238-d5c44132cb81 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.429973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.430544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.430822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.431092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.431192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed24bb1-de3a-4d58-813e-d0730dd6b779 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.431818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:09.432124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:09.433573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:09.446991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 342/674] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:09.447863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.476084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67b017-810a-4935-98a1-1be09433884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.477038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67b017-810a-4935-98a1-1be09433884b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.477469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67b017-810a-4935-98a1-1be09433884b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.477915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67b017-810a-4935-98a1-1be09433884b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.491484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67b017-810a-4935-98a1-1be09433884b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-0e67b017-810a-4935-98a1-1be09433884b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:09.496641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:09.497731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:09.498758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 333/675] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:09.499606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45c4b-cf19-4d4b-b270-857bd45afe34 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.499606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45c4b-cf19-4d4b-b270-857bd45afe34 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.500132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45c4b-cf19-4d4b-b270-857bd45afe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.520826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-56c45c4b-cf19-4d4b-b270-857bd45afe34 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:09.522016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-56c45c4b-cf19-4d4b-b270-857bd45afe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:09.568822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b003d-0720-4bc9-a78a-684912298fab None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.588276 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:09.596426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 334/676] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:09.597239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c45c4b-cf19-4d4b-b270-857bd45afe34 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.617210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.618844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.619349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.620106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.621170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:09.621485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:09.623245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:09.635818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 343/677] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:09.638848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.655887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:09.710223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c45c4b-cf19-4d4b-b270-857bd45afe34 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.745723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fa0a5-d0c9-410c-8904-d865897d0217 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.745954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.746348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.746629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.746899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.747609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=b1d5fb05964b47d5a2f33fe9dde1f65f) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:09.747929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:09.749347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:09.764026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 335/678] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/role_assignments?user.id=b1d5fb05964b47d5a2f33fe9dde1f65f&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:09.764026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.795113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.795886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.796266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.796633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.797672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:09.798093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:09.800653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:09.814615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 344/679] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:09.815705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:09.842027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:09.902895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728249-daf1-4016-9e42-7f7fcf71b386 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.931642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:09.952093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beadb2-fcd2-45b6-8d5a-0b6643fd2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:09.952717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beadb2-fcd2-45b6-8d5a-0b6643fd2958 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:09.952993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beadb2-fcd2-45b6-8d5a-0b6643fd2958 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:09.953279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beadb2-fcd2-45b6-8d5a-0b6643fd2958 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:09.961561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9ba8-a5eb-402d-a197-41f0424c8b9f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:09.965459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beadb2-fcd2-45b6-8d5a-0b6643fd2958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-87beadb2-fcd2-45b6-8d5a-0b6643fd2958 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:09.971258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:09.972194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:09.973035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 336/680] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:09.973731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beadb2-fcd2-45b6-8d5a-0b6643fd2958 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.016479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.017716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.017996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.018347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.030699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.032365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:10.046846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:10.047814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 345/681] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:10.048741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.105794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beadb2-fcd2-45b6-8d5a-0b6643fd2958 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.138369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:10.148380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.149009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.149286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.149555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.160370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.161547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12773a6c-810b-44d8-9e84-0b8573df80fd None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.161821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:10.176416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:10.177390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:10.178319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:10.178319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:10.178319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:10.178319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 337/682] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:10.178707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.203766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.204986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.205381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.205654 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.206495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:10.206806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.208834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.212048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:10.222635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 346/683] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:10.223765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.283402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d87f-e56b-4581-b583-f475959a20a9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.318655 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.319453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.319840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.320217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.321165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:10.321517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.323410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.336350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 338/684] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:10.337325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.356707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eff41-3df1-424a-a825-55611a99b148 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.372828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:10.406461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.407069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.407350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.407624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.408798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:10.409102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.410498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.422268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 347/685] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:10.423190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.464242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff2561-0510-48ec-901f-ad940b49ddeb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.494476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:10.509134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.509971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.510543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.510923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.525968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.527904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.529247 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5d768-3a00-4efe-9902-5c89910e093b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:10.547621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:10.549161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:10.550780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:10.550780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:10.550780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:10.550780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 339/686] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:10.551884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.572297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.572906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.573187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.573461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.574393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=17a501a048ed4b6c8186bfd490ad1394) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:10.574629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.576117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.591207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 348/687] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/role_assignments?user.id=17a501a048ed4b6c8186bfd490ad1394&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:10.591431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.662461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:10.680326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8c09f-6879-42a2-be03-40f158a591a3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.721217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.722264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.722780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.723243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.731804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.734166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:10.748201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:10.749225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:10.750200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:10.753174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 340/688] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:10.758467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.848289 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daea60e-ad16-4e65-8e39-5d8b3bd865d9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.877789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:10.896399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.897261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.897550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.897827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.898917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:10.899231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.900945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.902207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34da0-8e04-4ac8-8c15-0887269aece6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:10.915946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 349/689] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:10.922728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.955764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:10.957001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:10.957765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:10.958699 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:10.959934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:10.960468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:10.963283 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:10.986872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 341/690] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:10.993074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:10.997309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:11.042248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446e08-4bf6-4003-bb79-e25abc6448bf None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:11.099702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:11.100828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:11.100828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:11.101109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:11.108792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:11.118347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:11.129167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4c7a1-21e0-405d-b7a4-1680af2ae989 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:11.131128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:11.132076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:11.133049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:11.138112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 350/691] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:11.147855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:11.176311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58544ca3-8ec2-43a1-a2da-8f4a110f99fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:11.177334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544ca3-8ec2-43a1-a2da-8f4a110f99fb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:11.177823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544ca3-8ec2-43a1-a2da-8f4a110f99fb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:11.178366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544ca3-8ec2-43a1-a2da-8f4a110f99fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:11.220826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:11.288207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254eed5-ce74-4ee6-b74b-80d795a5d010 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:11.342790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:11.343418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:11.343697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:11.343975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:11.344698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:11.345013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:11.346542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:11.352421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58544ca3-8ec2-43a1-a2da-8f4a110f99fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:11.354153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58544ca3-8ec2-43a1-a2da-8f4a110f99fb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:11.357192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:11.385664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 351/692] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 00:16:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:11.411175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:11.494678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 342/693] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:16:11.500223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58544ca3-8ec2-43a1-a2da-8f4a110f99fb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:11.546036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:11.550357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105cf5-4a1d-4777-956d-0cbbf8890a49 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:11.589231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6701c4b-af32-47e0-b927-333ac43af65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:11.590252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701c4b-af32-47e0-b927-333ac43af65f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:11.590772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701c4b-af32-47e0-b927-333ac43af65f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:11.591273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701c4b-af32-47e0-b927-333ac43af65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:11.646220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58544ca3-8ec2-43a1-a2da-8f4a110f99fb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:11.648430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:11.681244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6701c4b-af32-47e0-b927-333ac43af65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:11.683075 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6701c4b-af32-47e0-b927-333ac43af65f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:11.696033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c442b3-2d5d-40f5-a46a-b9ed9800a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:11.696665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c442b3-2d5d-40f5-a46a-b9ed9800a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:11.696941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c442b3-2d5d-40f5-a46a-b9ed9800a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:11.697213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c442b3-2d5d-40f5-a46a-b9ed9800a6e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:11.711188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c442b3-2d5d-40f5-a46a-b9ed9800a6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:11.712919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c442b3-2d5d-40f5-a46a-b9ed9800a6e8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-f3c442b3-2d5d-40f5-a46a-b9ed9800a6e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:11.737368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:11.738392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:11.743529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:11.743529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:11.743529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:11.743529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 343/694] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:11.743529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00579b-7c61-44ab-a04c-a9ef9ab695fe None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:11.743529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00579b-7c61-44ab-a04c-a9ef9ab695fe None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:11.743529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00579b-7c61-44ab-a04c-a9ef9ab695fe None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:11.743529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 344/695] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:11.750303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00579b-7c61-44ab-a04c-a9ef9ab695fe None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:11.803377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:11.818127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 352/696] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 00:16:11.818127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4893e6-4e24-4135-a876-38a3cfe89d5e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:11.818127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4893e6-4e24-4135-a876-38a3cfe89d5e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:11.818127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4893e6-4e24-4135-a876-38a3cfe89d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:11.839946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ec4893e6-4e24-4135-a876-38a3cfe89d5e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:11.841563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ec4893e6-4e24-4135-a876-38a3cfe89d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:11.892415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00579b-7c61-44ab-a04c-a9ef9ab695fe None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:11.937138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:11.942377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 353/697] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:11.942377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4893e6-4e24-4135-a876-38a3cfe89d5e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:11.943407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:11.943898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:11.944375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:11.945264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:11.945790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:11.951589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:11.972318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 345/698] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:11.978132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:11.996718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:12.065415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4893e6-4e24-4135-a876-38a3cfe89d5e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.090961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc440c69-b37a-4246-b6ad-3ca389b8153a None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.096084 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:12.103520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.104264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.104545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.104923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.116564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.118532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.125430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0be24-14f2-4d30-b4f7-59a41773e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.126055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0be24-14f2-4d30-b4f7-59a41773e77b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.127343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0be24-14f2-4d30-b4f7-59a41773e77b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.127629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0be24-14f2-4d30-b4f7-59a41773e77b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:12.134703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:12.135610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:12.136471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:12.136471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:12.136471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:12.136658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0be24-14f2-4d30-b4f7-59a41773e77b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.136658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0be24-14f2-4d30-b4f7-59a41773e77b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.140569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 354/699] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:12.141173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7fc0be24-14f2-4d30-b4f7-59a41773e77b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:12.148550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:12.149409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:12.150893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 346/700] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:12.151450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5f77-fd8b-4c2b-bdc9-2bb0d539654f None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.151450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5f77-fd8b-4c2b-bdc9-2bb0d539654f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.151751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5f77-fd8b-4c2b-bdc9-2bb0d539654f None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.152983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 347/701] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:12.157819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5f77-fd8b-4c2b-bdc9-2bb0d539654f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.260675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe583-7865-4bc6-bdfb-8789186dc663 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.269239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:12.297616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5f77-fd8b-4c2b-bdc9-2bb0d539654f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.298230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.299109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.299384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.299762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.300435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.301802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:12.313018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:12.314083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:12.314987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 355/702] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:12.315847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.341703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe4976-4392-4d2b-a4b1-1ebfb4f3ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.342610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe4976-4392-4d2b-a4b1-1ebfb4f3ce62 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.343081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe4976-4392-4d2b-a4b1-1ebfb4f3ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.343355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe4976-4392-4d2b-a4b1-1ebfb4f3ce62 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.343992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe4976-4392-4d2b-a4b1-1ebfb4f3ce62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:12.344299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe4976-4392-4d2b-a4b1-1ebfb4f3ce62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.346305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe4976-4392-4d2b-a4b1-1ebfb4f3ce62 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.358582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 348/703] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:12.359849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0852e2-8255-4f0a-b72a-d100acb40dc2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.360213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0852e2-8255-4f0a-b72a-d100acb40dc2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.360576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0852e2-8255-4f0a-b72a-d100acb40dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.372145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:12.379011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7c0852e2-8255-4f0a-b72a-d100acb40dc2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:12.380206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7c0852e2-8255-4f0a-b72a-d100acb40dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:12.432744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aee4c-304d-4eb1-82b1-f5d9af840356 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.451552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 349/704] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:12.452633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0852e2-8255-4f0a-b72a-d100acb40dc2 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.477787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.478457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.478845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.479121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.479813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:12.480126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.481674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.499251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 356/705] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:12.500412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.547896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:12.588331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0852e2-8255-4f0a-b72a-d100acb40dc2 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.617158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbf72-1a19-419b-a3a5-fbc0d142cf6f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.625045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.625311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:12.626123 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.626875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.627201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.627842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:12.628149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.629523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.638985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 350/706] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:12.638985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.663679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.664460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.665065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.665486 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.672745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.674259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:12.685311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:12.686321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 357/707] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:12.687257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.753994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc5b4-9ba6-4f42-80e5-09fa159439b0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.783597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:12.792744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.793426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.793639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.793909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.796649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e74c5-910c-4a68-877d-8ae66ae1c20f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:12.805682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.807178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:12.823251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:12.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:12.825337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:12.825337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:12.825337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:12.825337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 351/708] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:12.825337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.839584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:12.840122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:12.840399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:12.840680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:12.841388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=fe6573439abd4afb8098390eb4c7e5ef) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:12.841694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:12.843164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:12.854425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 358/709] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/role_assignments?user.id=fe6573439abd4afb8098390eb4c7e5ef&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:12.855353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:12.904772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:12.967864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8367b3c-4d51-4e05-9ae7-0f7e848a7072 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:13.006312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a94a23-38e6-420f-91ce-7023c3e7830c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:13.016026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:13.016873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.017326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.018176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.018292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:13.018831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:13.020230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:13.029195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 352/710] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:13.030282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:13.074822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:13.075666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.076047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.076428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.077294 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:13.077708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:13.079382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:13.088332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:13.106764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 359/711] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:13.122039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:13.163055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760250fb-a42d-4a28-9688-964c0d1bc406 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:13.207444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab051d-bf19-4580-a817-8e5b1d93bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:13.208426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab051d-bf19-4580-a817-8e5b1d93bf20 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.208999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab051d-bf19-4580-a817-8e5b1d93bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.209283 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab051d-bf19-4580-a817-8e5b1d93bf20 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.209959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab051d-bf19-4580-a817-8e5b1d93bf20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:13.210494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab051d-bf19-4580-a817-8e5b1d93bf20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:13.212630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab051d-bf19-4580-a817-8e5b1d93bf20 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:13.230793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 353/712] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:13.232197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8af4-7ee1-4f29-811c-e762e361a16d None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.232491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8af4-7ee1-4f29-811c-e762e361a16d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.232764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8af4-7ee1-4f29-811c-e762e361a16d None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.238167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 354/713] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:13.239348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e8af4-7ee1-4f29-811c-e762e361a16d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:13.271006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:13.286855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e5ba-cf91-4518-b1e3-906e073b328e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:13.333609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbc063-fb2d-4fe7-b367-1696e4fa16fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:13.335134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbc063-fb2d-4fe7-b367-1696e4fa16fa None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.335415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbc063-fb2d-4fe7-b367-1696e4fa16fa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.335689 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbc063-fb2d-4fe7-b367-1696e4fa16fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.336414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbc063-fb2d-4fe7-b367-1696e4fa16fa None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=faeb9592d8fd4906a1298e7e550c1e1f) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:13.336722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbc063-fb2d-4fe7-b367-1696e4fa16fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:13.338165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbc063-fb2d-4fe7-b367-1696e4fa16fa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:13.346893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 360/714] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:13 2022] GET /identity/v3/role_assignments?user.id=faeb9592d8fd4906a1298e7e550c1e1f&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:13.348210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85efe2-3f73-49d1-b650-25bb27dadc0d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.348793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85efe2-3f73-49d1-b650-25bb27dadc0d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.349071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85efe2-3f73-49d1-b650-25bb27dadc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.371433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4e85efe2-3f73-49d1-b650-25bb27dadc0d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:13.372678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4e85efe2-3f73-49d1-b650-25bb27dadc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:13.377685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e8af4-7ee1-4f29-811c-e762e361a16d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:13.380348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:13.421114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20852e9-713a-4624-af20-8c9941d83519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:13.421886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20852e9-713a-4624-af20-8c9941d83519 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.422200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20852e9-713a-4624-af20-8c9941d83519 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.422477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20852e9-713a-4624-af20-8c9941d83519 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.424041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20852e9-713a-4624-af20-8c9941d83519 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:13.425553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20852e9-713a-4624-af20-8c9941d83519 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:13.458473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 355/715] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:16:13 2022] POST /identity/v3/users => generated 254 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:16:13.493064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 361/716] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:13.515786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20852e9-713a-4624-af20-8c9941d83519 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:13.665302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20852e9-713a-4624-af20-8c9941d83519 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:13.710833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:13.711463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.711741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.712008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] PATH_INFO: `/v3/services/network` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.712594 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:13.713960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:13.725079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:13.726958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:13.728054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 356/717] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:13 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:13.732973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85efe2-3f73-49d1-b650-25bb27dadc0d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:13.823740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:13.840919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85efe2-3f73-49d1-b650-25bb27dadc0d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:13.879556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0cfe3-b32a-4dd2-a0ff-a8b183acb486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:13.880172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0cfe3-b32a-4dd2-a0ff-a8b183acb486 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:13.880450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0cfe3-b32a-4dd2-a0ff-a8b183acb486 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:13.880720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0cfe3-b32a-4dd2-a0ff-a8b183acb486 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:13.881347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0cfe3-b32a-4dd2-a0ff-a8b183acb486 None admin] RBAC: Adding query filter params (name=network) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:13.881646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0cfe3-b32a-4dd2-a0ff-a8b183acb486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:13.883185 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0cfe3-b32a-4dd2-a0ff-a8b183acb486 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:13.888294 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 362/718] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:13.893697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:13.922810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:14.004925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3bacc-5162-4fc5-aac1-3ad570003bbc None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:14.041067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ae2dc-2097-4ee8-aa80-eb921ad6565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:14.041731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae2dc-2097-4ee8-aa80-eb921ad6565e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:14.042016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae2dc-2097-4ee8-aa80-eb921ad6565e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:14.042325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae2dc-2097-4ee8-aa80-eb921ad6565e None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:14.043007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae2dc-2097-4ee8-aa80-eb921ad6565e None admin] RBAC: Adding query filter params (type=network) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:14.043375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae2dc-2097-4ee8-aa80-eb921ad6565e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:14.044751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae2dc-2097-4ee8-aa80-eb921ad6565e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:14.050511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 357/719] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:14.995647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e06d47-7420-40fd-be97-ce074c74a83d None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:14.996165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e06d47-7420-40fd-be97-ce074c74a83d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:14.996165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e06d47-7420-40fd-be97-ce074c74a83d None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:14.997810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 363/720] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:15.003535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7293d7-7d75-423c-a49c-dae7fd2bf5b3 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:15.003821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7293d7-7d75-423c-a49c-dae7fd2bf5b3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:15.004095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7293d7-7d75-423c-a49c-dae7fd2bf5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:15.031096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-5b7293d7-7d75-423c-a49c-dae7fd2bf5b3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:15.032310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5b7293d7-7d75-423c-a49c-dae7fd2bf5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:15.138087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 358/721] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 00:16:15.172437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e06d47-7420-40fd-be97-ce074c74a83d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:15.305832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e06d47-7420-40fd-be97-ce074c74a83d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:15.352587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e577d0-a867-493c-97ff-08dff16125a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:15.353223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e577d0-a867-493c-97ff-08dff16125a7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:15.353506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e577d0-a867-493c-97ff-08dff16125a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:15.353784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e577d0-a867-493c-97ff-08dff16125a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:15.375092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e577d0-a867-493c-97ff-08dff16125a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-27e577d0-a867-493c-97ff-08dff16125a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:15.380356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:15.381265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:15.382117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 364/722] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:15.387585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7293d7-7d75-423c-a49c-dae7fd2bf5b3 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:15.433269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:15.556398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7293d7-7d75-423c-a49c-dae7fd2bf5b3 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:15.601622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d1e1c-3acc-49a8-bc8c-10fec3c38b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:15.602268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1e1c-3acc-49a8-bc8c-10fec3c38b10 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:15.602553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1e1c-3acc-49a8-bc8c-10fec3c38b10 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:15.602826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1e1c-3acc-49a8-bc8c-10fec3c38b10 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:15.603504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1e1c-3acc-49a8-bc8c-10fec3c38b10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:15.603813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1e1c-3acc-49a8-bc8c-10fec3c38b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:15.605205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1e1c-3acc-49a8-bc8c-10fec3c38b10 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:15.614562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 359/723] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:15.619799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e577d0-a867-493c-97ff-08dff16125a7 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:15.671466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647c9e2-dbee-46a2-b185-a8fb932440d4 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:15.671765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647c9e2-dbee-46a2-b185-a8fb932440d4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:15.672025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647c9e2-dbee-46a2-b185-a8fb932440d4 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:15.673584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 360/724] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:15.679217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf611-8849-4f0a-8af7-2d8356c1db12 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:15.679842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf611-8849-4f0a-8af7-2d8356c1db12 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:15.680331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf611-8849-4f0a-8af7-2d8356c1db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:15.700570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-2cdbf611-8849-4f0a-8af7-2d8356c1db12 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:15.702140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-2cdbf611-8849-4f0a-8af7-2d8356c1db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:15.799733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 361/725] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:15.811301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:15.875455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf611-8849-4f0a-8af7-2d8356c1db12 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:15.889517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:15.974022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e577d0-a867-493c-97ff-08dff16125a7 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:15.995668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf611-8849-4f0a-8af7-2d8356c1db12 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:16.038331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f50d1b-b9cb-4235-9e49-6114dfb64a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.039739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f50d1b-b9cb-4235-9e49-6114dfb64a52 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.041367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f50d1b-b9cb-4235-9e49-6114dfb64a52 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.043017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f50d1b-b9cb-4235-9e49-6114dfb64a52 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.043859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f50d1b-b9cb-4235-9e49-6114dfb64a52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:16.045499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f50d1b-b9cb-4235-9e49-6114dfb64a52 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:16.061200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cdf83-a386-4828-bcb1-855736e98231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.063076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cdf83-a386-4828-bcb1-855736e98231 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.063735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cdf83-a386-4828-bcb1-855736e98231 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.064275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cdf83-a386-4828-bcb1-855736e98231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.078169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 362/726] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:16:15 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:16:16.083467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cdf83-a386-4828-bcb1-855736e98231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:16.085257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cdf83-a386-4828-bcb1-855736e98231 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-af6cdf83-a386-4828-bcb1-855736e98231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:16.103011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:16.104004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:16.104861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:16.104861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:16.104861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:16.110208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 365/727] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:16.113757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f50d1b-b9cb-4235-9e49-6114dfb64a52 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:16.155000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1e1a1-346c-46da-b149-0245e0f945c1 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.155651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1e1a1-346c-46da-b149-0245e0f945c1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.156119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1e1a1-346c-46da-b149-0245e0f945c1 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.157760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 366/728] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:16.166154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a729a8-a35f-4821-b3b5-258a27e31bb2 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.166769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a729a8-a35f-4821-b3b5-258a27e31bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.167257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a729a8-a35f-4821-b3b5-258a27e31bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.197900 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-59a729a8-a35f-4821-b3b5-258a27e31bb2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:16.200201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-59a729a8-a35f-4821-b3b5-258a27e31bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:16.256056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:16.296057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f50d1b-b9cb-4235-9e49-6114dfb64a52 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:16.298740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:16.316421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 367/729] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:16.317668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a5472-94ff-48ad-aa3d-164e82d4fb53 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.317949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a5472-94ff-48ad-aa3d-164e82d4fb53 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.318286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a5472-94ff-48ad-aa3d-164e82d4fb53 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.322138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 368/730] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:16.324828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503cab-56f0-4275-95db-0766bdd0cfdc None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.325105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503cab-56f0-4275-95db-0766bdd0cfdc None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.325372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503cab-56f0-4275-95db-0766bdd0cfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.347017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bb503cab-56f0-4275-95db-0766bdd0cfdc None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:16.348201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bb503cab-56f0-4275-95db-0766bdd0cfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:16.352352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.353220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.353718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.354234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.355081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:16.355580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:16.357697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:16.373346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 363/731] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:16.374548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:16.434091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 369/732] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:16.434091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb503cab-56f0-4275-95db-0766bdd0cfdc None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:16.501392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc493a-7d02-4b4a-a958-9303582e8b04 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:16.537149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de302c-2823-4ed9-8016-ca832e8157d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.537947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb503cab-56f0-4275-95db-0766bdd0cfdc None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:16.538383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de302c-2823-4ed9-8016-ca832e8157d5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.538858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de302c-2823-4ed9-8016-ca832e8157d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.539324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de302c-2823-4ed9-8016-ca832e8157d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.549867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de302c-2823-4ed9-8016-ca832e8157d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-64de302c-2823-4ed9-8016-ca832e8157d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:16.555295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:16.556192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:16.557032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:16.559078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:16.560199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:16.560650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 364/733] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:16.570188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de302c-2823-4ed9-8016-ca832e8157d5 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:16.577601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.578264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.578543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.578810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.587006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:16.588425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:16.600720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:16.601681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:16.602875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:16.606409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 370/734] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:16:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:16.607243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:16.708890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de302c-2823-4ed9-8016-ca832e8157d5 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:16.731751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a588b-2e3a-453c-b044-1cf1fdc665c3 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:16.751971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dc8b-c687-41aa-b2c3-c290cc3d4618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.753118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dc8b-c687-41aa-b2c3-c290cc3d4618 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.753402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dc8b-c687-41aa-b2c3-c290cc3d4618 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.753955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dc8b-c687-41aa-b2c3-c290cc3d4618 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.766108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8c7da-a2c0-4a7a-9515-4e31fcffca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.766706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c7da-a2c0-4a7a-9515-4e31fcffca7c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.766933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3dc8b-c687-41aa-b2c3-c290cc3d4618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:16.767163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c7da-a2c0-4a7a-9515-4e31fcffca7c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.767433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c7da-a2c0-4a7a-9515-4e31fcffca7c None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.768077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c7da-a2c0-4a7a-9515-4e31fcffca7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:16.768626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c7da-a2c0-4a7a-9515-4e31fcffca7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:16.769965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c7da-a2c0-4a7a-9515-4e31fcffca7c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-1ed3dc8b-c687-41aa-b2c3-c290cc3d4618 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:16.772611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:16.773589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:16.774812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 365/735] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:16.775510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dc8b-c687-41aa-b2c3-c290cc3d4618 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:16.781026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 371/736] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:16.782602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5606d-629c-47e7-8600-a7f6126cfc37 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.783134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5606d-629c-47e7-8600-a7f6126cfc37 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.783609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5606d-629c-47e7-8600-a7f6126cfc37 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.785009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 372/737] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:16.785914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5606d-629c-47e7-8600-a7f6126cfc37 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:16.832394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:16.834436 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:16.896522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5606d-629c-47e7-8600-a7f6126cfc37 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:16.898963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dc8b-c687-41aa-b2c3-c290cc3d4618 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:16.935274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.935470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6f0e0-56a4-44ce-ace1-97993e034be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:16.935876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6f0e0-56a4-44ce-ace1-97993e034be6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.936157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6f0e0-56a4-44ce-ace1-97993e034be6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.936430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6f0e0-56a4-44ce-ace1-97993e034be6 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.936859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.937153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6f0e0-56a4-44ce-ace1-97993e034be6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:16.937459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6f0e0-56a4-44ce-ace1-97993e034be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:16.937672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.938142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.938961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6f0e0-56a4-44ce-ace1-97993e034be6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:16.939182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:16.939666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:16.942106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:16.955725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 373/738] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:16.955725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:16.959839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 366/739] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:16:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:16.964131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f752ed-ef50-408a-bf36-eba021ebd33b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:16.964131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f752ed-ef50-408a-bf36-eba021ebd33b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:16.964131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f752ed-ef50-408a-bf36-eba021ebd33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:16.979451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c6f752ed-ef50-408a-bf36-eba021ebd33b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:16.980626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c6f752ed-ef50-408a-bf36-eba021ebd33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:17.050339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 367/740] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 00:16:17.051799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f752ed-ef50-408a-bf36-eba021ebd33b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.061545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909beb4-d959-4dc5-872d-2437bdc49c9d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.069724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:17.099435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:17.100568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.101197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.101474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.101748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.112053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.113464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:17.128143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:17.129074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:17.129966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:17.129966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:17.129966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:17.129966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 374/741] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:17.129966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.176034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f752ed-ef50-408a-bf36-eba021ebd33b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.211030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.211659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.211938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.212214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.223262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.224517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.239742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8bb20-e438-4ecf-876c-8bf9f0bab32a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:17.239911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:17.240813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:17.241700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:17.241700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:17.241700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:17.241700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 368/742] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:17.242244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.280262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ed26-fea0-4920-8637-531342467198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.280877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ed26-fea0-4920-8637-531342467198 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.281319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ed26-fea0-4920-8637-531342467198 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.281591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ed26-fea0-4920-8637-531342467198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.296210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ed26-fea0-4920-8637-531342467198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.297669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ed26-fea0-4920-8637-531342467198 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-0688ed26-fea0-4920-8637-531342467198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:17.312752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:17.314396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:17.315308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:17.315308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:17.315308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:17.315308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 375/743] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:17.315308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ed26-fea0-4920-8637-531342467198 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.328802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:17.342948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:17.359821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f795-2608-42fd-8cc5-524e60fdacde None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.397279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6006-25f7-472a-ab8e-0724017e0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.397886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6006-25f7-472a-ab8e-0724017e0312 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.398202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6006-25f7-472a-ab8e-0724017e0312 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.398481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6006-25f7-472a-ab8e-0724017e0312 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.399120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef6006-25f7-472a-ab8e-0724017e0312 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.400492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef6006-25f7-472a-ab8e-0724017e0312 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.415048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 369/744] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:16:17 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:17.415883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6006-25f7-472a-ab8e-0724017e0312 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.445053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ed26-fea0-4920-8637-531342467198 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.508337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.509068 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.509420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.509773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.510597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:17.510981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.512934 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.529949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 376/745] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:17.529949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.559269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6006-25f7-472a-ab8e-0724017e0312 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.604812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:17.607281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.608666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.608666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.608666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.609100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:17.609402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.611395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.626887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 370/746] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:17.630117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.643084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:17.652852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ce8ee-1e4a-43e8-ac86-3dabd9e88bb6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.692148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.693069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.693569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.694041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.694811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:17.695122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.696582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.710606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 377/747] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:17.711521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.757755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd2ff-fef7-49cc-923f-a42936aff125 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.804232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.804869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.805151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.805425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.814803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.815970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:17.832316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:17.833316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:17.834295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:17.834832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 371/748] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:17.836251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.845781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd58ff-5e35-47fe-aec4-4009dbb1d87d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:17.886202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:17.898974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:17.899611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:17.900002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:17.900290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:17.908050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:17.909487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:17.926402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:17.927777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:17.928701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:17.929639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:17.933977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 378/749] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:17.934913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:17.964130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf718ac-7fa8-463d-90e3-32ef99398cf6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.007871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.008893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.009797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.010300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.021872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.023361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:18.035565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:18.036476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:18.037373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:18.037373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:18.037373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:18.037373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:18.037373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:18.037373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:18.037373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:18.037373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:18.041438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 372/750] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:18.042310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:18.067852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3490e9-673c-4351-bf72-5710838ef78a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.105587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.106612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.107121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.107649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.108691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:18.109215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.110932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.129894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 379/751] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 00:16:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:18.131130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:18.153428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48759-1a45-40c6-8162-1b72de56d39f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.177779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:18.183117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:18.193545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.194201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.194486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.194760 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.195492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:18.195885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.197512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.217271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 373/752] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 00:16:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:18.218245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:18.242977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9dd8-e25d-403e-bc63-91f9cfff8335 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.284554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f61390-1da6-4e94-ac7f-d06e6d144bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.285427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f61390-1da6-4e94-ac7f-d06e6d144bea None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.285866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f61390-1da6-4e94-ac7f-d06e6d144bea None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.286169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f61390-1da6-4e94-ac7f-d06e6d144bea None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.286850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f61390-1da6-4e94-ac7f-d06e6d144bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:18.287171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f61390-1da6-4e94-ac7f-d06e6d144bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.288549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f61390-1da6-4e94-ac7f-d06e6d144bea None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.302414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 380/753] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:18.304263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be77ae-fea3-452d-8594-07c8006ae77c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.304780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be77ae-fea3-452d-8594-07c8006ae77c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.305501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be77ae-fea3-452d-8594-07c8006ae77c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.307180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 381/754] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:18.308053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be77ae-fea3-452d-8594-07c8006ae77c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:18.325624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c75199-20a9-4165-aecf-a6bb209b9102 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.362809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7ae3c-0f95-413a-93fe-c240d09a90ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.363411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ae3c-0f95-413a-93fe-c240d09a90ba None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.363695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ae3c-0f95-413a-93fe-c240d09a90ba None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.363970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ae3c-0f95-413a-93fe-c240d09a90ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.413832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be77ae-fea3-452d-8594-07c8006ae77c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.415636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:18.418978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:18.437220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7ae3c-0f95-413a-93fe-c240d09a90ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.439343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7ae3c-0f95-413a-93fe-c240d09a90ba None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.450121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fae6c0-c411-47a7-b276-9dfdc3e56a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.450725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae6c0-c411-47a7-b276-9dfdc3e56a19 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.451005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae6c0-c411-47a7-b276-9dfdc3e56a19 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.451286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae6c0-c411-47a7-b276-9dfdc3e56a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.524259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fae6c0-c411-47a7-b276-9dfdc3e56a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.525716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fae6c0-c411-47a7-b276-9dfdc3e56a19 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.554319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 374/755] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:16:18.554319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7ae3c-0f95-413a-93fe-c240d09a90ba None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:18.637354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:18.642718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 382/756] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:16:18.648709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2751c1f-84db-4f4d-a875-68c98a06ea89 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.649006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2751c1f-84db-4f4d-a875-68c98a06ea89 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.649279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2751c1f-84db-4f4d-a875-68c98a06ea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.656338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7ae3c-0f95-413a-93fe-c240d09a90ba None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.656607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:18.669583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c2751c1f-84db-4f4d-a875-68c98a06ea89 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:18.670752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c2751c1f-84db-4f4d-a875-68c98a06ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:18.693222 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37285921-c7e2-4b1d-a94e-d85ef765727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.693984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37285921-c7e2-4b1d-a94e-d85ef765727d None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.694402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37285921-c7e2-4b1d-a94e-d85ef765727d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.694677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37285921-c7e2-4b1d-a94e-d85ef765727d None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/fe6573439abd4afb8098390eb4c7e5ef/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.696643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37285921-c7e2-4b1d-a94e-d85ef765727d None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=fe6573439abd4afb8098390eb4c7e5ef, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.698247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37285921-c7e2-4b1d-a94e-d85ef765727d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.720844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 375/757] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:18 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/fe6573439abd4afb8098390eb4c7e5ef/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:18.720844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37285921-c7e2-4b1d-a94e-d85ef765727d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:18.748283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 383/758] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:18.749178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2751c1f-84db-4f4d-a875-68c98a06ea89 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:18.888101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2751c1f-84db-4f4d-a875-68c98a06ea89 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.892537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37285921-c7e2-4b1d-a94e-d85ef765727d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:18.930453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:18.934859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.935561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.935906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.936243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.940864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:18.941672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:18.942154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:18.942586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:18.948173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.949705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.956400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:18.958542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:18.962135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:18.965363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:18.966600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:18.967748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:18.967748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:18.967748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:18.973541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 384/759] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:18.973541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:18.982620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:18.983584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:18.984931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:18.984931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:18.984931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:18.984931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 376/760] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:18.984931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.097210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccea5b-9d5a-418d-adb3-75fec3244768 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.107687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80bd1-0d45-4fc3-94a5-91e98531678f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.134243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.134874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.135156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.135493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.136142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:19.136813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.138018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.150912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 377/761] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:19.152071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.159624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.160529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.161008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.161493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.162335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.164512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:19.178685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:19.179685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:19.180537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:19.187871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 385/762] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 8 00:16:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:19.187871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.223805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:19.256800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:19.273268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee287bf-d765-43cc-9837-2d2898d2dbb0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.319093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba991-577f-4b3f-9d8d-f934704b9c2a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.320872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.322577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.323009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.323424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.324239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:19.324686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.326324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.342455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 378/763] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:19.343560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.361224 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.361969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.362343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.362683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.370344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.371792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:19.385358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:19.386622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:19.387661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:19.387661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:19.387661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:19.387661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:19.387661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:19.387661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:19.387661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:19.387661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:19.391952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 386/764] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:19.392826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.476797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f044-db69-4148-971d-adb5d0444b64 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.499801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:19.515504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c716e74-794c-4a20-ad9d-7448e9ad6068 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.524451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.525056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.525333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.525599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.526269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:19.526512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:19.526623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.527915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.533848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 379/765] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:19.534690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.558640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c955a-49bf-4afe-b985-46b29bbbc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.559529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c955a-49bf-4afe-b985-46b29bbbc09f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.559994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c955a-49bf-4afe-b985-46b29bbbc09f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.560469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c955a-49bf-4afe-b985-46b29bbbc09f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.568014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c955a-49bf-4afe-b985-46b29bbbc09f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.569656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c955a-49bf-4afe-b985-46b29bbbc09f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-766c955a-49bf-4afe-b985-46b29bbbc09f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:19.582102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:19.583145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:19.584234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:19.584234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:19.584234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:19.584234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:19.584234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:19.584234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:19.584234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:19.584234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:19.590575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 387/766] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:19.591925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdfc3-c31b-4dc0-9e56-490efd5b875c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.592363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdfc3-c31b-4dc0-9e56-490efd5b875c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.592788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdfc3-c31b-4dc0-9e56-490efd5b875c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.594357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 388/767] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:19.595757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cdfc3-c31b-4dc0-9e56-490efd5b875c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.644078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5b29-e23e-4919-b380-bc6435e1237e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.679694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.680289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.680574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.680970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.681545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:19.681851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.683301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.700759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 380/768] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:19.700759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.707262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cdfc3-c31b-4dc0-9e56-490efd5b875c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.742664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc0af-5f17-4aa3-aed0-48f48c9fdf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.743186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc0af-5f17-4aa3-aed0-48f48c9fdf6e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.743760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc0af-5f17-4aa3-aed0-48f48c9fdf6e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.743760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc0af-5f17-4aa3-aed0-48f48c9fdf6e None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.744333 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc0af-5f17-4aa3-aed0-48f48c9fdf6e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:19.744633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc0af-5f17-4aa3-aed0-48f48c9fdf6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.745981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc0af-5f17-4aa3-aed0-48f48c9fdf6e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.746433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:19.752228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 389/769] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:19.753367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dad4b-50f2-42fb-b515-57bf1f560fe3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.753651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dad4b-50f2-42fb-b515-57bf1f560fe3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.753922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dad4b-50f2-42fb-b515-57bf1f560fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.772545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-7c5dad4b-50f2-42fb-b515-57bf1f560fe3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:19.773760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7c5dad4b-50f2-42fb-b515-57bf1f560fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:19.800522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:19.814086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9200d-f35f-4893-a0d0-c27fa9d7a67b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.855111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:19.855969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:19.856400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:19.856821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:19.862105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 390/770] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:19.862105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dad4b-50f2-42fb-b515-57bf1f560fe3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.862941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:19.863261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:19.864738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:19.882179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 381/771] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:19.882179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:19.977384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dad4b-50f2-42fb-b515-57bf1f560fe3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:19.987817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:19.991217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701012-8dfa-4261-8d8f-c7fe8bdd8446 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:20.013914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:20.014517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.014802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.015076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.015797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=ae7cde8433d046ec9cacb1665c03cd66) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:20.016102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:20.018082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:20.028516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:20.029294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.029680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.030095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.030918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] RBAC: Adding query filter params (interface=public, service_id=8428d966fe524fc0ab43b3d00539c4bd, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:20.031344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 391/772] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/role_assignments?user.id=ae7cde8433d046ec9cacb1665c03cd66&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:20.031462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:20.032204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:20.033026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:20.046962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 382/773] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 00:16:19 2022] GET /identity/v3/endpoints?service_id=8428d966fe524fc0ab43b3d00539c4bd&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:20.048462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:20.072662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:20.171040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2200c1f-012b-4474-a356-51ec1ce3f9b7 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:20.182862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70921-575c-4a34-9222-9c4f8132292e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:20.217067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:20.218130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.218682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.218960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] PATH_INFO: `/v3/services/network` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.219548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:20.221870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:20.226465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:20.227170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.227530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.227876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.228673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=faeb9592d8fd4906a1298e7e550c1e1f) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:20.229056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:20.230589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:20.231431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:20.232386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:20.233211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 392/774] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:20 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:20.239233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:20.242168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 383/775] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:20 2022] GET /identity/v3/role_assignments?user.id=faeb9592d8fd4906a1298e7e550c1e1f&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:20.247497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:20.307212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:20.398566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8318a-a23e-421e-b794-9f6b14b12158 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:20.410533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:20.444990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d883dd6-6b65-47ec-b76b-9a5c8cc890d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:20.446639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883dd6-6b65-47ec-b76b-9a5c8cc890d0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.447099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883dd6-6b65-47ec-b76b-9a5c8cc890d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.447522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883dd6-6b65-47ec-b76b-9a5c8cc890d0 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.448287 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d883dd6-6b65-47ec-b76b-9a5c8cc890d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:20.449456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce3d31-71ff-4330-8530-dc1f61f72c43 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:20.450103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d883dd6-6b65-47ec-b76b-9a5c8cc890d0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:20.456817 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 393/776] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:16:20 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:20.491522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:20.492148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.492430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.492706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.493364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] RBAC: Adding query filter params (name=network) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:20.493672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:20.495136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:20.501606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 384/777] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:20.506992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d883dd6-6b65-47ec-b76b-9a5c8cc890d0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:20.659921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d883dd6-6b65-47ec-b76b-9a5c8cc890d0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:20.696317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6208-2564-47fa-b882-e835da842833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:20.696919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6208-2564-47fa-b882-e835da842833 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.697199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6208-2564-47fa-b882-e835da842833 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.697471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6208-2564-47fa-b882-e835da842833 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.698118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b6208-2564-47fa-b882-e835da842833 None admin] RBAC: Adding query filter params (type=network) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:20.698427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b6208-2564-47fa-b882-e835da842833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:20.699784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b6208-2564-47fa-b882-e835da842833 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:20.705094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 394/778] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:20.710877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:20.800030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6624d2-9019-4e70-ba7e-6124e015eb75 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.800571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6624d2-9019-4e70-ba7e-6124e015eb75 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.801002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6624d2-9019-4e70-ba7e-6124e015eb75 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.803758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 395/779] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:20.808051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d1fa2-8057-44cc-9936-6f8d5a98666d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.808447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d1fa2-8057-44cc-9936-6f8d5a98666d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.808792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d1fa2-8057-44cc-9936-6f8d5a98666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.815764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:20.828080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70363-92c0-4e4e-bc50-c31429410b65 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:20.844606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9b8d1fa2-8057-44cc-9936-6f8d5a98666d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:20.846582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9b8d1fa2-8057-44cc-9936-6f8d5a98666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:20.875941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:20.899851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:20.900458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:20.900735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:20.901005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:20.901702 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] RBAC: Adding query filter params (interface=public, service_id=62f5ec2f58e7447bab5603d69b3b101b, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:20.902007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:20.903492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:20.910542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 385/780] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 00:16:20 2022] GET /identity/v3/endpoints?service_id=62f5ec2f58e7447bab5603d69b3b101b&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:20.919214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:20.968776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 396/781] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:21.003367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d1fa2-8057-44cc-9936-6f8d5a98666d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:21.066726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7361-3273-432b-97bf-9d46c596cf54 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:21.132875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff0e0-67c7-4f62-af5b-e6986feb2c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:21.133493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff0e0-67c7-4f62-af5b-e6986feb2c2d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:21.133772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff0e0-67c7-4f62-af5b-e6986feb2c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:21.134045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff0e0-67c7-4f62-af5b-e6986feb2c2d None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:21.134704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ff0e0-67c7-4f62-af5b-e6986feb2c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:21.136204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ff0e0-67c7-4f62-af5b-e6986feb2c2d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:21.142142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 386/782] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:16:20 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:21.194118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d1fa2-8057-44cc-9936-6f8d5a98666d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:21.248081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8300d-a860-45f6-b8db-63139813b50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:21.248718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8300d-a860-45f6-b8db-63139813b50e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:21.248995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8300d-a860-45f6-b8db-63139813b50e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:21.249265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8300d-a860-45f6-b8db-63139813b50e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:21.267303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8300d-a860-45f6-b8db-63139813b50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-d9b8300d-a860-45f6-b8db-63139813b50e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:21.272527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:21.273549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:21.274475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 397/783] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:21.280445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff0e0-67c7-4f62-af5b-e6986feb2c2d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:21.326435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:21.442335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff0e0-67c7-4f62-af5b-e6986feb2c2d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:21.490083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:21.490761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:21.491047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:21.491321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:21.491988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:21.492293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:21.493668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:21.502596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 387/784] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:21.511230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8300d-a860-45f6-b8db-63139813b50e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:21.533075 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:21.629924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8300d-a860-45f6-b8db-63139813b50e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:21.664434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:21.665070 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:21.665348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:21.665620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:21.676454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:21.677955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:21.694924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:21.697152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:21.699330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:21.699330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:21.699330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:21.699330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 398/785] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:21.702657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:21.815167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:21.832614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe68e4c-86a8-415a-ae48-9592d4be190c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:21.879895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:21.880522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:21.880812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:21.881094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:21.881745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:21.882056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:21.883465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:21.906108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 388/786] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:21.912155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:21.998435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:22.048957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363efc3-e3cf-446e-9e33-ab6a47d68919 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:22.097375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:22.098044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.098352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.098630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] PATH_INFO: `/v3/users/nova` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.106657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:22.108164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:22.119687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:22.121893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:22.124104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 399/787] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:16:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:22.131318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:22.263814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c4627-abdb-4a8e-99cd-259d2484f4a6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:22.308037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd247559-3cd8-4e18-8cda-8db156827ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:22.308800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247559-3cd8-4e18-8cda-8db156827ada None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.308978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247559-3cd8-4e18-8cda-8db156827ada None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.309224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247559-3cd8-4e18-8cda-8db156827ada None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.309887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd247559-3cd8-4e18-8cda-8db156827ada None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:22.310228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd247559-3cd8-4e18-8cda-8db156827ada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:22.311665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd247559-3cd8-4e18-8cda-8db156827ada None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:22.327548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:22.331755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 389/788] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:16:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:22.338614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:22.464915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7ed3-448f-4f75-bb9b-6cf3d8f9dcef None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:22.492157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:22.511452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08140694-ead3-4114-bd2d-02a681b04ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:22.512105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08140694-ead3-4114-bd2d-02a681b04ee7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.512386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08140694-ead3-4114-bd2d-02a681b04ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.512730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08140694-ead3-4114-bd2d-02a681b04ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.561149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e05b6b-d478-4409-ab35-6974334581ae None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.561448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e05b6b-d478-4409-ab35-6974334581ae None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.561691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e05b6b-d478-4409-ab35-6974334581ae None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.563053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 390/789] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:22.569151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa938-5391-46f7-ad80-2b17be16facf None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.569427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa938-5391-46f7-ad80-2b17be16facf None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.569696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa938-5391-46f7-ad80-2b17be16facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.597375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08140694-ead3-4114-bd2d-02a681b04ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:22.597735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-32baa938-5391-46f7-ad80-2b17be16facf None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:22.598966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-32baa938-5391-46f7-ad80-2b17be16facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:22.599450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08140694-ead3-4114-bd2d-02a681b04ee7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:22.707637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 391/790] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:22.719304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 400/791] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:16:22.724634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baa938-5391-46f7-ad80-2b17be16facf None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:22.752623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08140694-ead3-4114-bd2d-02a681b04ee7 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:22.786895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:22.870479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baa938-5391-46f7-ad80-2b17be16facf None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:22.893751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08140694-ead3-4114-bd2d-02a681b04ee7 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:22.902045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:22.909608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345888c-5aed-435a-bb27-3f82cb5637e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:22.910555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345888c-5aed-435a-bb27-3f82cb5637e0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.910984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345888c-5aed-435a-bb27-3f82cb5637e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.911410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345888c-5aed-435a-bb27-3f82cb5637e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.923696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345888c-5aed-435a-bb27-3f82cb5637e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:22.925404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345888c-5aed-435a-bb27-3f82cb5637e0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:22.937583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdb291-e8c2-4ba3-b9c5-8e07658a51f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:22.938430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdb291-e8c2-4ba3-b9c5-8e07658a51f3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.938798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdb291-e8c2-4ba3-b9c5-8e07658a51f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.939165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdb291-e8c2-4ba3-b9c5-8e07658a51f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-4345888c-5aed-435a-bb27-3f82cb5637e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:22.941570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:22.942661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:22.943550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:22.943550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:22.943550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:22.945559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 392/792] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:22.947015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd758d-67a2-4bf4-8b41-97754ba61c00 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.947500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd758d-67a2-4bf4-8b41-97754ba61c00 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.947959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd758d-67a2-4bf4-8b41-97754ba61c00 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.949676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 393/793] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:22.952959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd758d-67a2-4bf4-8b41-97754ba61c00 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:22.957737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdb291-e8c2-4ba3-b9c5-8e07658a51f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-bffdb291-e8c2-4ba3-b9c5-8e07658a51f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:22.963801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:22.964719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:22.965560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:22.967393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 401/794] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:22.973144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3cb1-315a-435f-ab39-6a3117d65a4d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:22.973144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3cb1-315a-435f-ab39-6a3117d65a4d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:22.973144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3cb1-315a-435f-ab39-6a3117d65a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:22.996124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a73f3cb1-315a-435f-ab39-6a3117d65a4d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:22.998179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a73f3cb1-315a-435f-ab39-6a3117d65a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:23.080853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd758d-67a2-4bf4-8b41-97754ba61c00 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.086353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 402/795] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:23.087467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f3cb1-315a-435f-ab39-6a3117d65a4d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.103897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:23.121653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ff51-a650-48fb-8058-f9e709496a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.122296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ff51-a650-48fb-8058-f9e709496a2b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.122578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ff51-a650-48fb-8058-f9e709496a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.122850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ff51-a650-48fb-8058-f9e709496a2b None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.123610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ff51-a650-48fb-8058-f9e709496a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:23.124071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ff51-a650-48fb-8058-f9e709496a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.125439 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ff51-a650-48fb-8058-f9e709496a2b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.137941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 394/796] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:23.138980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd75edd-c0dd-4e09-98f3-f44889007375 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.139267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd75edd-c0dd-4e09-98f3-f44889007375 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.139543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd75edd-c0dd-4e09-98f3-f44889007375 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.140849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 395/797] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:23.142867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd75edd-c0dd-4e09-98f3-f44889007375 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.190956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:23.206310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f3cb1-315a-435f-ab39-6a3117d65a4d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.242669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.243201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.243474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.243746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.244400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:23.244704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.246076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.253615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd75edd-c0dd-4e09-98f3-f44889007375 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.255437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 403/798] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:23.256252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.298556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bad0dc-8b73-4154-82c9-5c929a59ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.299483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad0dc-8b73-4154-82c9-5c929a59ed44 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.299483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad0dc-8b73-4154-82c9-5c929a59ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.299778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad0dc-8b73-4154-82c9-5c929a59ed44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.310226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bad0dc-8b73-4154-82c9-5c929a59ed44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-47bad0dc-8b73-4154-82c9-5c929a59ed44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:23.314893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:23.315807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:23.316650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 396/799] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:23.317996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d1458-351a-4f10-8d4b-c74c835c414b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.317996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d1458-351a-4f10-8d4b-c74c835c414b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.317996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d1458-351a-4f10-8d4b-c74c835c414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.338181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:23.338727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b56d1458-351a-4f10-8d4b-c74c835c414b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:23.339939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b56d1458-351a-4f10-8d4b-c74c835c414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:23.370239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e83b7e-f3c9-483d-9a38-9e07fb86041c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.407807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.408437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.408717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.408989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.414665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 397/800] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:23.415768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d1458-351a-4f10-8d4b-c74c835c414b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.423565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.425021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:23.438541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:23.439509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:23.440844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:23.440844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:23.440844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:23.440844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:23.440844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:23.440844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:23.440844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:23.440844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:23.442355 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 404/801] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:23.443114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.457636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:23.529315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d1458-351a-4f10-8d4b-c74c835c414b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.551058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46212f4-9451-42a4-a222-1c01de28745b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.563707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.564323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.564600 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.564870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.575467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.577027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.581988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:23.588213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.588819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.589099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.589377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.590031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:23.590385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.591735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:23.592397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:23.593300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:23.594242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:23.594242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:23.594242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:23.594242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 398/802] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:23.594581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.611365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 405/803] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:23.611365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.691703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:23.709680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98897d-ce8f-4ab9-b25f-dc85165d0846 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.715483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118ba8-eaaf-44b8-8076-235bd16a3773 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.745748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.746399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.746681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.746953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.747535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.748908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.752584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.753174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.753453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.753718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.754424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:23.754726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.756113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:23.758213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:23.759182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:23.760025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 399/804] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:23.760826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.779753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 406/805] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:23.779753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.835184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:23.868657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8d59-42ae-42c3-8a35-f1233144c5e6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.881305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca3b71-05fa-499d-9afa-50ed1b2276c6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:23.902772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.903367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.903644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.903930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.904544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:23.904843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.906232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.914695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:23.915347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:23.915655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:23.915904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:23.917002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 400/806] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:23.917776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:23.928306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:23.930475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:23.931971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:23.946761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:23.947699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:23.948618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:23.948618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:23.948618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:23.948618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 407/807] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:23.948618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.020666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699ee72-96ab-49ed-9796-8769dae4fa3b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.047031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50034cf1-f652-4cf9-a196-9d5b4299fcb6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.053497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289e1dd-de67-486c-861a-160c215bb264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.054100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e1dd-de67-486c-861a-160c215bb264 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.054219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:24.054388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e1dd-de67-486c-861a-160c215bb264 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.054664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e1dd-de67-486c-861a-160c215bb264 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.055288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289e1dd-de67-486c-861a-160c215bb264 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:24.055679 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289e1dd-de67-486c-861a-160c215bb264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.057073 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289e1dd-de67-486c-861a-160c215bb264 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.066389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 401/808] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:24.066389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985f90c-fd60-4683-aa5c-0f8e3df050a3 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.066389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985f90c-fd60-4683-aa5c-0f8e3df050a3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.066389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985f90c-fd60-4683-aa5c-0f8e3df050a3 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.066389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 402/809] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:24.066389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985f90c-fd60-4683-aa5c-0f8e3df050a3 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.086544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.087136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.087415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.087690 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.088395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=fe6573439abd4afb8098390eb4c7e5ef) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:24.088701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.090114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.095772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 408/810] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:23 2022] GET /identity/v3/role_assignments?user.id=fe6573439abd4afb8098390eb4c7e5ef&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:24.096523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.148056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:24.182022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985f90c-fd60-4683-aa5c-0f8e3df050a3 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.214211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f512-fbf0-469f-b6cd-2f1c707ba31c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.218899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.219591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.219869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.220134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.228276 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.229752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:24.242801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:24.243803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:24.244730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 403/811] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:24.245342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.262532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2311fd8-7ac4-4723-8b9f-e9efca209dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.263549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311fd8-7ac4-4723-8b9f-e9efca209dbc None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.263818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311fd8-7ac4-4723-8b9f-e9efca209dbc None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.264245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311fd8-7ac4-4723-8b9f-e9efca209dbc None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.264886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2311fd8-7ac4-4723-8b9f-e9efca209dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:24.265191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2311fd8-7ac4-4723-8b9f-e9efca209dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.266634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2311fd8-7ac4-4723-8b9f-e9efca209dbc None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.280408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 409/812] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:24.281912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556a55-f744-4c90-b1e4-1e17e910e049 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.282282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556a55-f744-4c90-b1e4-1e17e910e049 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.282600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556a55-f744-4c90-b1e4-1e17e910e049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.307620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-16556a55-f744-4c90-b1e4-1e17e910e049 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:24.308739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-16556a55-f744-4c90-b1e4-1e17e910e049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:24.333390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:24.355654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca14f4-7dfd-43b6-ae80-afa43e47597b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.385745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:24.391462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.391765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 410/813] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:24.392193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.392459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.392808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.393756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:24.394040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16556a55-f744-4c90-b1e4-1e17e910e049 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.394164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.395578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.405081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 404/814] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:24.405081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.506957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16556a55-f744-4c90-b1e4-1e17e910e049 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.515839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc0d6-5725-4f00-b1a7-9651e79e4bb8 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.545265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.545779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.546058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.546591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.547091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:24.547444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.549437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.551991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.552613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.552896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.553169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.560846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.562235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.568573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 411/815] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:24.569822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:24.577296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:24.578284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 405/816] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:24.584093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.590187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:24.642890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:24.679209 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf346a-af55-4c14-a49e-4e05e4c1a2e5 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.691289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79990173-d90f-4cec-b35b-5e662bc74334 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.714215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3579d-66cf-4ede-8c0c-ccd6d6792715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.714822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3579d-66cf-4ede-8c0c-ccd6d6792715 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.715110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3579d-66cf-4ede-8c0c-ccd6d6792715 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.715387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3579d-66cf-4ede-8c0c-ccd6d6792715 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.716039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3579d-66cf-4ede-8c0c-ccd6d6792715 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.717396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3579d-66cf-4ede-8c0c-ccd6d6792715 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.727453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.728368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.728792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.729228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] PATH_INFO: `/v3/services/network` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.729807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.731229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:24.750093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:24.751410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 00:16:24.752414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:24.753324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 412/817] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:16:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:24.753324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3579d-66cf-4ede-8c0c-ccd6d6792715 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.753475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 406/818] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:24.753475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.863586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:24.882474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736800-665c-4779-9da5-486e4bd6c85f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.908995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:24.911620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3579d-66cf-4ede-8c0c-ccd6d6792715 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:24.927051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.927972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.928435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.928879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.929777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:24.930291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.931908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.955549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 407/819] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:24.957312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:24.959658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:24.960667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:24.961589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:24.961589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:24.973901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:24.975383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:24.990992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:24.992021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:24.992916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:24.992916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:24.992916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:24.992916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 413/820] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:24.992916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.086683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d2ed1-1ae7-4869-8afb-4fcc3702a281 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.113335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1b01-7554-4c0c-80dd-02b8894998a4 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.123227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.123835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.124117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.124386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.125016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] RBAC: Adding query filter params (name=network) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:25.125318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.127294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.132321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 408/821] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:25.133118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.139507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:25.153732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.154434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.154722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.154983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.168372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.169950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.179427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:25.188109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:25.189105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:25.189990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:25.189990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:25.189990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:25.189990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 414/822] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:25.190677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.239525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524557a4-f021-406f-b740-4cb124d5efd8 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.277338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.277949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.278263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.278537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.279180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:25.279486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.280920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.294646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 409/823] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:25.295519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.315484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a5728-e450-4e95-93bf-ea930a8a4f77 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.354040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.354792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.355090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.355368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.355996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] RBAC: Adding query filter params (type=network) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:25.356302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.357781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.364302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 415/824] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:25.365277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.403426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e530d-a0e4-47da-853e-54f645dd62f5 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.405047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:25.418843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:25.441253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.441867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.442177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.442453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.443095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:25.443398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.444768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.456558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 410/825] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:25.457365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.490568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf1428-364a-412f-be17-79bdd8427e5c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.529266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.529956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.530270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.530548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.538852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.540469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:25.553109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:25.555136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:25.557260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:25.557260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:25.557260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:25.557260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:25.557260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:25.557260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:25.557260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:25.557260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:25.566092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 416/826] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:25.566092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.566481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6949c-2d20-4554-aec1-9e3946ad3aed None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.596762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365372-f453-49ed-988d-70900f8d58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.597377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365372-f453-49ed-988d-70900f8d58c1 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.597656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365372-f453-49ed-988d-70900f8d58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.597929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365372-f453-49ed-988d-70900f8d58c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.598652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b365372-f453-49ed-988d-70900f8d58c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.600031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b365372-f453-49ed-988d-70900f8d58c1 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.629508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 411/827] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:16:25 2022] POST /identity/v3/endpoints => generated 337 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:25.630869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365372-f453-49ed-988d-70900f8d58c1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.664152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:25.681215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:25.686249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1a9c4-3c71-45bd-9b83-0fc83fe7e487 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.733198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.733854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.734168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.734448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.742368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.743884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:25.755680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:25.757759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:25.760018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 417/828] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:25.766119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365372-f453-49ed-988d-70900f8d58c1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.766963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.838896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.839526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.839806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.840079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.840787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:25.841098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.843650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:25.868721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 412/829] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:25.879060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:25.943356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9531f-1a08-4888-b491-98b5784b4d53 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:25.990375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:25.991062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:25.991343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:25.991671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:25.992384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:25.992689 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:25.994744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:26.011062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 418/830] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:26.016901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:26.019026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:26.032410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af71b5-0b08-4068-b3c5-ea0c97f47647 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:26.038139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:26.089359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b08cc-57d7-4d50-b084-317dfea72830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:26.090021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b08cc-57d7-4d50-b084-317dfea72830 None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.090334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b08cc-57d7-4d50-b084-317dfea72830 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.090602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b08cc-57d7-4d50-b084-317dfea72830 None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/ae7cde8433d046ec9cacb1665c03cd66/roles/db558e2340b04e8194fea3fe2b17b159` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.112018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b08cc-57d7-4d50-b084-317dfea72830 None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=ae7cde8433d046ec9cacb1665c03cd66, role_id=db558e2340b04e8194fea3fe2b17b159)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:26.113935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b08cc-57d7-4d50-b084-317dfea72830 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:26.130620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 413/831] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:25 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/ae7cde8433d046ec9cacb1665c03cd66/roles/db558e2340b04e8194fea3fe2b17b159 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:26.158038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c130ba-d5b5-4927-af6d-f6e91588eb30 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:26.197366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad5112-fa9a-49f8-a2c8-e42fe2442c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:26.198435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5112-fa9a-49f8-a2c8-e42fe2442c7d None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.198957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5112-fa9a-49f8-a2c8-e42fe2442c7d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.199442 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5112-fa9a-49f8-a2c8-e42fe2442c7d None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/faeb9592d8fd4906a1298e7e550c1e1f/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.201734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad5112-fa9a-49f8-a2c8-e42fe2442c7d None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=faeb9592d8fd4906a1298e7e550c1e1f, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:26.203480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad5112-fa9a-49f8-a2c8-e42fe2442c7d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:26.220425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 419/832] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:26 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/faeb9592d8fd4906a1298e7e550c1e1f/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:26.301657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a534bb7-6826-4961-968d-8c972dccb903 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.302402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a534bb7-6826-4961-968d-8c972dccb903 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.302892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a534bb7-6826-4961-968d-8c972dccb903 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.304890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 414/833] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:26.310337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b041b-bd50-449d-a7b7-ea06d38f3b28 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.310987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b041b-bd50-449d-a7b7-ea06d38f3b28 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.311459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b041b-bd50-449d-a7b7-ea06d38f3b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.332387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-406b041b-bd50-449d-a7b7-ea06d38f3b28 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:26.333955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-406b041b-bd50-449d-a7b7-ea06d38f3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:26.413621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 420/834] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:26.435493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a534bb7-6826-4961-968d-8c972dccb903 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:26.548719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a534bb7-6826-4961-968d-8c972dccb903 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:26.577214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:26.585855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:26.586540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.586818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.587086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.587666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:26.589038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:26.598726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:26.599676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:26.600591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 415/835] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 8 00:16:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:26.611515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b041b-bd50-449d-a7b7-ea06d38f3b28 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:26.616320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:26.721480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b041b-bd50-449d-a7b7-ea06d38f3b28 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:26.756420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14509328-e690-48a3-856f-8550a38a8e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:26.757027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14509328-e690-48a3-856f-8550a38a8e77 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.757303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14509328-e690-48a3-856f-8550a38a8e77 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.757571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14509328-e690-48a3-856f-8550a38a8e77 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.758225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14509328-e690-48a3-856f-8550a38a8e77 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:26.758527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14509328-e690-48a3-856f-8550a38a8e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:26.759891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14509328-e690-48a3-856f-8550a38a8e77 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:26.765033 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 421/836] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:26.775165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:26.893372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50106c58-0427-4865-8b57-ee5b8364b4d3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:26.906038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f13fa-de68-45f1-a208-b57ea59f3aec None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.906341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f13fa-de68-45f1-a208-b57ea59f3aec None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.906619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f13fa-de68-45f1-a208-b57ea59f3aec None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.908717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 422/837] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:26.913766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81247-4f4f-4eb5-9fa6-2584d0068dbe None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.914053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81247-4f4f-4eb5-9fa6-2584d0068dbe None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.914356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81247-4f4f-4eb5-9fa6-2584d0068dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.930922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:26.931523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:26.931801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:26.932081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:26.932182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-46e81247-4f4f-4eb5-9fa6-2584d0068dbe None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:26.932738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:26.933043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:26.933373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-46e81247-4f4f-4eb5-9fa6-2584d0068dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:26.934431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:26.941332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 416/838] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:27.009455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:27.016055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 423/839] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:27.039540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:27.103367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:27.151859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9b0d2-fec3-4f89-b66e-81d2c90507b0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:27.186354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:27.186982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:27.187265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:27.187533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:27.188141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:27.189502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:27.198172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:27.199148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:27.200012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 417/840] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:27.205892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81247-4f4f-4eb5-9fa6-2584d0068dbe None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:27.312608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81247-4f4f-4eb5-9fa6-2584d0068dbe None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:27.348904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ab0d1-1ebc-4f7c-9c2c-ecd43d065900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:27.349507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ab0d1-1ebc-4f7c-9c2c-ecd43d065900 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:27.349786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ab0d1-1ebc-4f7c-9c2c-ecd43d065900 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:27.350059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ab0d1-1ebc-4f7c-9c2c-ecd43d065900 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:27.350707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ab0d1-1ebc-4f7c-9c2c-ecd43d065900 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:27.351012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ab0d1-1ebc-4f7c-9c2c-ecd43d065900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:27.352436 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ab0d1-1ebc-4f7c-9c2c-ecd43d065900 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:27.357483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 424/841] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:27.363683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:27.473433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ebe0c-15be-497d-a7c6-793619e01013 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:27.494735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:27.509324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8c375-86be-41a0-b059-a8bb511080af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:27.509922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8c375-86be-41a0-b059-a8bb511080af None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:27.510248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8c375-86be-41a0-b059-a8bb511080af None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:27.510522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8c375-86be-41a0-b059-a8bb511080af None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:27.511152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8c375-86be-41a0-b059-a8bb511080af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:27.511455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8c375-86be-41a0-b059-a8bb511080af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:27.512824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8c375-86be-41a0-b059-a8bb511080af None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:27.517816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 418/842] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:28.276707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c622f9-88fb-414f-9e17-460d648b2d54 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.277226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c622f9-88fb-414f-9e17-460d648b2d54 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.277226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c622f9-88fb-414f-9e17-460d648b2d54 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.278914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 425/843] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:28.284025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce3c6a-b746-438e-914d-749c9217eaa8 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.284313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce3c6a-b746-438e-914d-749c9217eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.284587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce3c6a-b746-438e-914d-749c9217eaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.300791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb4f1-5599-4e39-80d8-606f911222c5 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.301120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb4f1-5599-4e39-80d8-606f911222c5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.301332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb4f1-5599-4e39-80d8-606f911222c5 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.302739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c1ce3c6a-b746-438e-914d-749c9217eaa8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:28.303038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 426/844] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:28.304085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c1ce3c6a-b746-438e-914d-749c9217eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:28.307749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3b18f-5511-4afd-ba6f-206452eb9e22 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.308032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3b18f-5511-4afd-ba6f-206452eb9e22 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.308307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3b18f-5511-4afd-ba6f-206452eb9e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.329382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-23d3b18f-5511-4afd-ba6f-206452eb9e22 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:28.330763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-23d3b18f-5511-4afd-ba6f-206452eb9e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:28.382494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 419/845] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:28.399108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:28.403415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce3c6a-b746-438e-914d-749c9217eaa8 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:28.419419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 427/846] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:28.445031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3b18f-5511-4afd-ba6f-206452eb9e22 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:28.504343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce3c6a-b746-438e-914d-749c9217eaa8 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:28.518891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:28.538898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23112806-5367-4428-997a-a7eed4e74742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:28.539950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23112806-5367-4428-997a-a7eed4e74742 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.540589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23112806-5367-4428-997a-a7eed4e74742 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.540818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23112806-5367-4428-997a-a7eed4e74742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.552265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23112806-5367-4428-997a-a7eed4e74742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-23112806-5367-4428-997a-a7eed4e74742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:28.557026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:28.558170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:28.559181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:28.562622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 420/847] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:28.568389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23112806-5367-4428-997a-a7eed4e74742 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:28.570614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3b18f-5511-4afd-ba6f-206452eb9e22 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:28.612768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d62c9-34a5-467f-8904-7cc9e0bcb697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:28.613484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d62c9-34a5-467f-8904-7cc9e0bcb697 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.613714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d62c9-34a5-467f-8904-7cc9e0bcb697 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.613988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d62c9-34a5-467f-8904-7cc9e0bcb697 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.624678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d62c9-34a5-467f-8904-7cc9e0bcb697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-236d62c9-34a5-467f-8904-7cc9e0bcb697 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:28.630086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:28.631073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:16:28.631898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:28.636703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 428/848] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:16:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:28.637735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d62c9-34a5-467f-8904-7cc9e0bcb697 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:28.697784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:28.710052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23112806-5367-4428-997a-a7eed4e74742 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:28.747897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:28.748884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.749245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d62c9-34a5-467f-8904-7cc9e0bcb697 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:28.749595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.750083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.751528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:28.752044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:28.753622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:28.767595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 421/849] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:28.769362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:28.787881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:28.788495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.788772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.789152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.789750 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:28.790123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:28.791536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:28.806163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 429/850] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:16:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:28.807187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:28.808773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:28.879185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09804170-5b3d-407a-ba3b-66ce2e918464 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:28.915726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:28.916347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.916623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.916896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.931018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:28.932474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:28.935317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428ab4d-4362-4d20-955f-3e29746dadfb None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:28.947371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:28.948350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:28.949252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:28.949252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:28.949252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:28.952953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 422/851] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:28.953809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:28.954599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:28.978480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:28.979446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:28.979978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:28.980557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:28.993515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:28.995307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:29.012019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:29.013066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:29.013950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:29.013950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:29.013950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:29.020946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 430/852] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:29.022020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:29.046274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:29.059303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3f9f-caed-4073-a800-92c3ee936f3e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.098934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066673b-cb4e-474f-a7eb-4ca20159b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.099577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066673b-cb4e-474f-a7eb-4ca20159b412 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.099855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066673b-cb4e-474f-a7eb-4ca20159b412 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.100127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066673b-cb4e-474f-a7eb-4ca20159b412 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.100795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066673b-cb4e-474f-a7eb-4ca20159b412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:29.101102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066673b-cb4e-474f-a7eb-4ca20159b412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:29.102476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066673b-cb4e-474f-a7eb-4ca20159b412 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.115738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 423/853] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:29.116962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8fa0-0cf2-4788-93a3-0212ad5e061f None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.117249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8fa0-0cf2-4788-93a3-0212ad5e061f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.117518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8fa0-0cf2-4788-93a3-0212ad5e061f None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.122176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 424/854] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:29.122176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8fa0-0cf2-4788-93a3-0212ad5e061f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:29.142696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262372e1-4b78-4316-bc47-a49c0ede72c1 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.179077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb722eb-37b2-4cfa-83ca-c720bb032bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.179683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb722eb-37b2-4cfa-83ca-c720bb032bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.180007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb722eb-37b2-4cfa-83ca-c720bb032bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.180281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb722eb-37b2-4cfa-83ca-c720bb032bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.180909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb722eb-37b2-4cfa-83ca-c720bb032bf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:29.181210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb722eb-37b2-4cfa-83ca-c720bb032bf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:29.182594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb722eb-37b2-4cfa-83ca-c720bb032bf4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.195031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 431/855] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:29.196284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b03f-aa2d-4c94-91b1-653428e050db None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.196570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b03f-aa2d-4c94-91b1-653428e050db None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.196841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b03f-aa2d-4c94-91b1-653428e050db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.214096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-11c2b03f-aa2d-4c94-91b1-653428e050db None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:29.215265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-11c2b03f-aa2d-4c94-91b1-653428e050db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:29.237216 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:29.240367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8fa0-0cf2-4788-93a3-0212ad5e061f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.276636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.277267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.277537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.277807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.284965 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:29.286418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.294099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 432/856] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:29.294099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2b03f-aa2d-4c94-91b1-653428e050db None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:29.305663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:29.306628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 00:16:29.307598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:29.309932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 425/857] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:29.314288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:29.326337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:29.404665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2b03f-aa2d-4c94-91b1-653428e050db None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.426665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f03e95-ed4a-4473-ba2b-979807fb0567 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.439888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.440519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.440807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.441053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.449231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:29.450815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:29.462840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:29.463797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 433/858] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:16:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:29.464719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:29.475778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dfd28-173f-446f-b8a3-e205f8ad4b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.476583 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dfd28-173f-446f-b8a3-e205f8ad4b4b None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.477035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dfd28-173f-446f-b8a3-e205f8ad4b4b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.477501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dfd28-173f-446f-b8a3-e205f8ad4b4b None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.478427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dfd28-173f-446f-b8a3-e205f8ad4b4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:29.480054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dfd28-173f-446f-b8a3-e205f8ad4b4b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.484839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:29.497559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 426/859] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:16:29 2022] POST /identity/v3/services => generated 269 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:16:29.506434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dfd28-173f-446f-b8a3-e205f8ad4b4b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:29.580794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94078d9b-cd6d-4493-bbfc-7ce987dca7a6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.583200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:29.623891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607ed11-fe94-4179-9ac4-1ab0cdbc733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.624512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ed11-fe94-4179-9ac4-1ab0cdbc733e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.624792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ed11-fe94-4179-9ac4-1ab0cdbc733e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.625064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ed11-fe94-4179-9ac4-1ab0cdbc733e None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.626381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607ed11-fe94-4179-9ac4-1ab0cdbc733e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:29.626630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dfd28-173f-446f-b8a3-e205f8ad4b4b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.626775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607ed11-fe94-4179-9ac4-1ab0cdbc733e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:29.628123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607ed11-fe94-4179-9ac4-1ab0cdbc733e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.652407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 434/860] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Aug 8 00:16:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:29.652407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325313b6-3bee-4bb9-a9dc-9d25c5faebcf None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.652407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325313b6-3bee-4bb9-a9dc-9d25c5faebcf None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.652407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325313b6-3bee-4bb9-a9dc-9d25c5faebcf None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.652407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 435/861] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:29.653299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325313b6-3bee-4bb9-a9dc-9d25c5faebcf None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:29.671063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c51faf-471b-416c-a381-82533b869b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.671664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c51faf-471b-416c-a381-82533b869b1e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.671969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c51faf-471b-416c-a381-82533b869b1e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.672269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c51faf-471b-416c-a381-82533b869b1e None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.673213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c51faf-471b-416c-a381-82533b869b1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:29.673321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c51faf-471b-416c-a381-82533b869b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:29.675385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c51faf-471b-416c-a381-82533b869b1e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.697051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 427/862] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 00:16:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:29.698831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df004b-d20a-432e-b564-731338221592 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.699327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df004b-d20a-432e-b564-731338221592 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.699803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df004b-d20a-432e-b564-731338221592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.718906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-38df004b-d20a-432e-b564-731338221592 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:29.720407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-38df004b-d20a-432e-b564-731338221592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:29.745643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:29.780385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325313b6-3bee-4bb9-a9dc-9d25c5faebcf None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.790794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 428/863] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:29 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:29.799383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df004b-d20a-432e-b564-731338221592 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:29.816440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036aa8-a60d-44fd-9d29-66fd270f0db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.817045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036aa8-a60d-44fd-9d29-66fd270f0db7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.817381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036aa8-a60d-44fd-9d29-66fd270f0db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.817591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036aa8-a60d-44fd-9d29-66fd270f0db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.874015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:29.890480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6036aa8-a60d-44fd-9d29-66fd270f0db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:29.892456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6036aa8-a60d-44fd-9d29-66fd270f0db7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:29.922005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df004b-d20a-432e-b564-731338221592 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:29.959251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a64829-c2e9-4b4e-a855-d3d3331e23e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:29.959858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64829-c2e9-4b4e-a855-d3d3331e23e2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:29.960141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64829-c2e9-4b4e-a855-d3d3331e23e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:29.960414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64829-c2e9-4b4e-a855-d3d3331e23e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:29.961619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:29.998152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 436/864] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:29 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:16:29.999063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036aa8-a60d-44fd-9d29-66fd270f0db7 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.036393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a64829-c2e9-4b4e-a855-d3d3331e23e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.037884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a64829-c2e9-4b4e-a855-d3d3331e23e2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.095251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:30.103473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036aa8-a60d-44fd-9d29-66fd270f0db7 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.141102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15cd5-9a06-40ca-b3dd-9cd2a996145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.141622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15cd5-9a06-40ca-b3dd-9cd2a996145b None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.141911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15cd5-9a06-40ca-b3dd-9cd2a996145b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.142212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15cd5-9a06-40ca-b3dd-9cd2a996145b None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.147555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 429/865] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:29 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:16:30.147693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15cd5-9a06-40ca-b3dd-9cd2a996145b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.147788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a64829-c2e9-4b4e-a855-d3d3331e23e2 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.147864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15cd5-9a06-40ca-b3dd-9cd2a996145b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.170110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 437/866] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:16:29 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:30.170110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15cd5-9a06-40ca-b3dd-9cd2a996145b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.217266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:30.278708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a64829-c2e9-4b4e-a855-d3d3331e23e2 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.323548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15cd5-9a06-40ca-b3dd-9cd2a996145b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.326316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.326958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.327237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.327506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.339482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.341762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:30.361923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:30.362921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:30.364538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:30.364538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:30.364538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:30.364538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 430/867] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:30.366448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.367540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.367540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.367733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.368729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.374099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:30.383080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.384848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:30.402641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:30.403587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:30.404476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:30.404476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:30.404476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:30.404476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 438/868] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:30.411518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.500353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dda9e6-ad60-4edf-989a-67a30d123c9d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.501827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:30.528009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9becb-7378-4a66-9db5-3e3d0c1d4d9f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.555225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.555834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.556363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.556642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.557707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:30.558016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.559939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.565755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.566696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.567079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.567455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.568191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:30.568597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.570108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.578161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 431/869] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:30.581248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.586161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 439/870] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:30.594933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.659541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:30.701268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99b8da-07a6-43f2-ade1-6dea4c988e3e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.718356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032b517-1ff9-41e6-a41f-ba4669c7679d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.744590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.745216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.745773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.746046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.755333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.757086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.762772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.763397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.763673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.763942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:30.771273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:30.772151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:30.773044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:30.773044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:30.773044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:30.773044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:30.773044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:30.773044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:30.773044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:30.773044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:30.773473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.774058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.780066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 432/871] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:30.780196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:30.782243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:30.789677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:30.790745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:30.791656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:30.791656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:30.791656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:30.791656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:30.791656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:30.791656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:30.791656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:30.791656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:30.794834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 440/872] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:30.800072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.918718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ee1a4-f25a-4704-846e-d5624a700884 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.926142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc0b9b-3195-49cc-90c2-78c923b10c10 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:30.959951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:30.962236 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.962857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.963214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.963708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.964466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:30.966282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.966381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.975456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:30.976904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:30.977391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:30.977901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:30.979343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:30.979954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:30.981667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:30.987242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 441/873] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:30.988567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:30.996756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 433/874] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:31.003267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:31.054001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:31.100587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908af3c9-1826-444b-9629-edef2fb10f64 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:31.133519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ce9de-cb78-4c9f-bb6a-3d1451711d04 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:31.148031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574719-5449-464d-b796-7e77936df15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:31.149103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574719-5449-464d-b796-7e77936df15b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:31.150012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574719-5449-464d-b796-7e77936df15b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:31.150614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574719-5449-464d-b796-7e77936df15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:31.151646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574719-5449-464d-b796-7e77936df15b None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=ae7cde8433d046ec9cacb1665c03cd66) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:31.152395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574719-5449-464d-b796-7e77936df15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:31.154432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574719-5449-464d-b796-7e77936df15b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:31.163442 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 442/875] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:30 2022] GET /identity/v3/role_assignments?user.id=ae7cde8433d046ec9cacb1665c03cd66&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:31.173996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5bf58-7280-433e-ad88-82bce14515cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:31.175034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bf58-7280-433e-ad88-82bce14515cc None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:31.175541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bf58-7280-433e-ad88-82bce14515cc None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:31.176025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bf58-7280-433e-ad88-82bce14515cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:31.176998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5bf58-7280-433e-ad88-82bce14515cc None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=faeb9592d8fd4906a1298e7e550c1e1f) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:31.177546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5bf58-7280-433e-ad88-82bce14515cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:31.179306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5bf58-7280-433e-ad88-82bce14515cc None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:31.187016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 434/876] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:31 2022] GET /identity/v3/role_assignments?user.id=faeb9592d8fd4906a1298e7e550c1e1f&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:31.555745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf54d2-f798-4369-90dc-00d599caa3e4 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:31.556309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf54d2-f798-4369-90dc-00d599caa3e4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:31.556405 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf54d2-f798-4369-90dc-00d599caa3e4 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:31.557818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 443/877] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:31.563717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6ad8-7dfe-44bb-8897-2502f10f5fa0 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:31.564126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6ad8-7dfe-44bb-8897-2502f10f5fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:31.564328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6ad8-7dfe-44bb-8897-2502f10f5fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:31.583229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-0c8a6ad8-7dfe-44bb-8897-2502f10f5fa0 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:31.584438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0c8a6ad8-7dfe-44bb-8897-2502f10f5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:31.632432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:31.659833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 435/878] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:31.682231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf54d2-f798-4369-90dc-00d599caa3e4 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:31.792729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf54d2-f798-4369-90dc-00d599caa3e4 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:31.817769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:31.830908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:31.831573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:31.831857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:31.832143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:31.832740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:31.834114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:31.843073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:31.844076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:31.845559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 444/879] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 8 00:16:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:31.860861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a6ad8-7dfe-44bb-8897-2502f10f5fa0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:31.967377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a6ad8-7dfe-44bb-8897-2502f10f5fa0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:32.009857 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:32.010507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:32.010788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:32.011062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:32.011695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:32.011998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:32.013443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:32.019075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 436/880] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:32.024425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:32.134299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404679-dd17-4c06-b7c0-fff461286e75 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:32.169905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:32.170929 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:32.171426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:32.171920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:32.173379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:32.173890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:32.175626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:32.181173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 445/881] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:32.191126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:32.236065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:32.294901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe3e0-9f67-4205-9a9c-dd97504dd861 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:32.330663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd7c3d-102a-42a1-8a13-92e6af3b6667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:32.331271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7c3d-102a-42a1-8a13-92e6af3b6667 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:32.331551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7c3d-102a-42a1-8a13-92e6af3b6667 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:32.331824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7c3d-102a-42a1-8a13-92e6af3b6667 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:32.332516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd7c3d-102a-42a1-8a13-92e6af3b6667 None admin] RBAC: Adding query filter params (interface=public, service_id=1c8c2e9a306d4d5a9cbfa0040cd64a43, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:32.332825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd7c3d-102a-42a1-8a13-92e6af3b6667 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:32.334213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd7c3d-102a-42a1-8a13-92e6af3b6667 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:32.339717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 437/882] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 00:16:32 2022] GET /identity/v3/endpoints?service_id=1c8c2e9a306d4d5a9cbfa0040cd64a43&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:32.345361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:32.414525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:32.418709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7973-ffc6-47d2-8dcf-a31035313181 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:32.419184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7973-ffc6-47d2-8dcf-a31035313181 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:32.419354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7973-ffc6-47d2-8dcf-a31035313181 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:32.420733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 438/883] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:32.427165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53fa4-5fdb-4560-b6a6-0f2559173378 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:32.427453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53fa4-5fdb-4560-b6a6-0f2559173378 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:32.427725 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53fa4-5fdb-4560-b6a6-0f2559173378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:32.446710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-40d53fa4-5fdb-4560-b6a6-0f2559173378 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:32.447953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-40d53fa4-5fdb-4560-b6a6-0f2559173378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:32.461008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febbed9-12ad-4d9f-b614-88f77bae4b1a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:32.501025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b0f2-2d1c-4669-a683-3d03cdf92bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:32.501746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b0f2-2d1c-4669-a683-3d03cdf92bef None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:32.502033 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b0f2-2d1c-4669-a683-3d03cdf92bef None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:32.502428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b0f2-2d1c-4669-a683-3d03cdf92bef None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:32.503038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12b0f2-2d1c-4669-a683-3d03cdf92bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:32.504515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12b0f2-2d1c-4669-a683-3d03cdf92bef None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:32.510952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 446/884] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:16:32 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:16:32.523380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 439/885] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:32.546521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b0f2-2d1c-4669-a683-3d03cdf92bef None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:32.658537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b0f2-2d1c-4669-a683-3d03cdf92bef None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:32.674105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:32.696963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:32.697591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:32.697873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:32.698193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:32.698783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:32.700131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:32.709475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:32.710519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:32.711384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 447/886] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:32.716546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53fa4-5fdb-4560-b6a6-0f2559173378 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:32.762109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:32.836597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53fa4-5fdb-4560-b6a6-0f2559173378 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:32.881371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:32.881984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:32.882349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:32.882632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:32.883316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:32.883623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:32.885089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:32.890543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 440/887] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:32.897985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.006506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28769884-a2ec-4efb-945a-a2579be57858 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:33.042523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:33.043525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.044031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.044532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.045353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:33.045855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:33.047961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:33.053499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 448/888] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:33.058983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.167994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:33.171756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef929f-3132-4d2c-a09d-308d47e6c22c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:33.209168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c76bcf-ac59-4e4e-9f31-ceacd09b5d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:33.209778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c76bcf-ac59-4e4e-9f31-ceacd09b5d2b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.210059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c76bcf-ac59-4e4e-9f31-ceacd09b5d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.210362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c76bcf-ac59-4e4e-9f31-ceacd09b5d2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.211066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c76bcf-ac59-4e4e-9f31-ceacd09b5d2b None admin] RBAC: Adding query filter params (interface=public, service_id=203a322eba5f486f897a120812d06c9e, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:33.211377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c76bcf-ac59-4e4e-9f31-ceacd09b5d2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:33.212756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c76bcf-ac59-4e4e-9f31-ceacd09b5d2b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:33.218757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 441/889] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 00:16:33 2022] GET /identity/v3/endpoints?service_id=203a322eba5f486f897a120812d06c9e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:33.223999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.270310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:33.337608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6d884-0994-44dd-9449-ec5d0fa89c97 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:33.372204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eccf52-8c19-4e8f-af9e-2002e76d3af6 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.372930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eccf52-8c19-4e8f-af9e-2002e76d3af6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.373198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555883f-98dc-47bc-ba03-e839a8147646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:33.373659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eccf52-8c19-4e8f-af9e-2002e76d3af6 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.373784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555883f-98dc-47bc-ba03-e839a8147646 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.374103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555883f-98dc-47bc-ba03-e839a8147646 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.374365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555883f-98dc-47bc-ba03-e839a8147646 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.374965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555883f-98dc-47bc-ba03-e839a8147646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:33.376792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 442/890] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:33.376974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555883f-98dc-47bc-ba03-e839a8147646 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:33.382087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e00e1-f888-4657-a9d3-4d643c81a199 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.382627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e00e1-f888-4657-a9d3-4d643c81a199 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.383205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e00e1-f888-4657-a9d3-4d643c81a199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.383383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 449/891] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:16:33 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:16:33.398479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599608-1afd-4dab-bd6e-fdffad6eac0b None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.398797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599608-1afd-4dab-bd6e-fdffad6eac0b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.399028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599608-1afd-4dab-bd6e-fdffad6eac0b None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.400718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 450/892] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:33.407505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-298e00e1-f888-4657-a9d3-4d643c81a199 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:33.407696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc09d-9cd8-476b-a47d-1f02552a03c7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.407923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc09d-9cd8-476b-a47d-1f02552a03c7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.408102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc09d-9cd8-476b-a47d-1f02552a03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.408743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-298e00e1-f888-4657-a9d3-4d643c81a199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:33.431788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-7d1cc09d-9cd8-476b-a47d-1f02552a03c7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:33.433523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7d1cc09d-9cd8-476b-a47d-1f02552a03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:33.507659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 443/893] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:33.521161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 451/894] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:33.531346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e00e1-f888-4657-a9d3-4d643c81a199 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.545379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc09d-9cd8-476b-a47d-1f02552a03c7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.584069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:33.661856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc09d-9cd8-476b-a47d-1f02552a03c7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:33.665648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:33.675760 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e00e1-f888-4657-a9d3-4d643c81a199 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:33.699795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dce24-23f3-4853-b498-7190e42fb762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:33.700471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dce24-23f3-4853-b498-7190e42fb762 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.700757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dce24-23f3-4853-b498-7190e42fb762 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.701027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dce24-23f3-4853-b498-7190e42fb762 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.715579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dce24-23f3-4853-b498-7190e42fb762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-1b5dce24-23f3-4853-b498-7190e42fb762 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:33.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:33.723297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:33.724184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 452/895] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 00:16:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:33.726812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:33.728019 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.728556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.729032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.729828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:33.730999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dce24-23f3-4853-b498-7190e42fb762 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.731694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:33.741764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:33.742980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:33.743812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:33.746500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 444/896] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:33.757293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.848768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:33.858035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dce24-23f3-4853-b498-7190e42fb762 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:33.891844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3adc9e-298b-4554-a5ef-a8902cfafed1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:33.902746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:33.903358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.903640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.903914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.904575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:33.905239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:33.907583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:33.917997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 453/897] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 00:16:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:33.922983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.942799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:33.943647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:33.944076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:33.944496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:33.945263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:33.945711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:33.947275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:33.952668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 445/898] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:33.959597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:33.994859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:34.036927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751609-ee68-4447-94dc-3e50645dc0db None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:34.084860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087486d7-c628-4614-b409-339cb4a9da42 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:34.085488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:34.086262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.086646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.087275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.101947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:34.104255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:34.123553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:34.124765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:34.126351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:34.126351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:34.126351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:34.127551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 454/899] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:34.127748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:34.128604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.129056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.129499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.130349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:34.130821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:34.132509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:34.132700 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:34.142291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 446/900] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:34.150484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:34.251693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21a032-f673-4ade-8739-6de4ba743f67 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:34.289714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:34.290371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.290652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.290923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.291633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:34.291939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:34.293360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:34.306268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 455/901] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:34.313231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:34.401768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:34.416378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8001b-f8b6-43ec-b51f-89fafef9a940 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:34.452074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2cc4e-fe3d-4199-b184-6e867ba2c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:34.452710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cc4e-fe3d-4199-b184-6e867ba2c846 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.452993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cc4e-fe3d-4199-b184-6e867ba2c846 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.453319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cc4e-fe3d-4199-b184-6e867ba2c846 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.461013 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2cc4e-fe3d-4199-b184-6e867ba2c846 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:34.462512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2cc4e-fe3d-4199-b184-6e867ba2c846 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-b3f2cc4e-fe3d-4199-b184-6e867ba2c846 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:34.474011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:34.475000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:34.475984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 447/902] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:16:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:34.483089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:34.559233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:34.597354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedaa1c-9f33-4162-8492-7505baac8834 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:34.641969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:34.646100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.646100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.646100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.646100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:34.646100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:34.646100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:34.654688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634fc4-dde6-44e9-8885-b1abd155729d None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.655361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634fc4-dde6-44e9-8885-b1abd155729d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.656775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634fc4-dde6-44e9-8885-b1abd155729d None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.658780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 448/903] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:34.664432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b279d-8070-4c51-9e50-49e9dabdddd4 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.664722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b279d-8070-4c51-9e50-49e9dabdddd4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.665001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b279d-8070-4c51-9e50-49e9dabdddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.667990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 456/904] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 00:16:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:34.674492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:34.686563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-982b279d-8070-4c51-9e50-49e9dabdddd4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:34.688436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-982b279d-8070-4c51-9e50-49e9dabdddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:34.774140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 449/905] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:34.786274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfddd3a-835a-45ba-8e79-d0a8a334f9be None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:34.793086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b279d-8070-4c51-9e50-49e9dabdddd4 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:34.817377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:34.827876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b4d6a-d0ad-4a63-b9cc-abd0cb925843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:34.828513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4d6a-d0ad-4a63-b9cc-abd0cb925843 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.828802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4d6a-d0ad-4a63-b9cc-abd0cb925843 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.829077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4d6a-d0ad-4a63-b9cc-abd0cb925843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.885528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:34.910728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b4d6a-d0ad-4a63-b9cc-abd0cb925843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:34.912517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b4d6a-d0ad-4a63-b9cc-abd0cb925843 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:34.924110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b279d-8070-4c51-9e50-49e9dabdddd4 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:34.965622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:34.967147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:34.967735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:34.968191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:34.969657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:34.971693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:34.983315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:34.984274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 00:16:34.985757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:34.993323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 450/906] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Aug 8 00:16:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:34.994822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.037380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 457/907] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:34 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 00:16:35.038507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b4d6a-d0ad-4a63-b9cc-abd0cb925843 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.068162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:35.124967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448f60-7eef-4983-b402-00bb80dbe7f9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:35.158404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b4d6a-d0ad-4a63-b9cc-abd0cb925843 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:35.162117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:35.162864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.163277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.163652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.164387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:35.164796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:35.166409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:35.176737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 451/908] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:35.177952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.181894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:35.205361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:35.206574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.207028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.207452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.221894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:35.223519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:35.242162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:35.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:35.244504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:35.244504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:35.244504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:35.251355 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 458/909] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:35.252185 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.308012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1513-cc7f-4a34-9dc8-1f2a131db63c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:35.344789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:35.355200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:35.356280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.356700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.356977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.357752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:35.359037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:35.361139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:35.362808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ed4e9-bf56-47d4-80ed-8200ef18d28a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:35.372576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 452/910] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:35.373446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.411880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:35.412874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.413279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.413694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.414427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:35.414918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:35.417131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:35.434164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 459/911] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:35.438727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.466429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:35.505388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd6966-ff81-4d23-800c-a956b8f3ff1c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:35.548349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac933c-2842-496b-913a-2c3789307ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:35.548953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac933c-2842-496b-913a-2c3789307ab4 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.549235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac933c-2842-496b-913a-2c3789307ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.549510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac933c-2842-496b-913a-2c3789307ab4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.549827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed29b96-4ad4-45ad-99bb-8abc5fc7889d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:35.550206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac933c-2842-496b-913a-2c3789307ab4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:35.551652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac933c-2842-496b-913a-2c3789307ab4 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:35.579458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 453/912] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:16:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:35.582034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae4bc-688a-48b6-8049-6fc1bbe2a080 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.583088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae4bc-688a-48b6-8049-6fc1bbe2a080 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.583565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae4bc-688a-48b6-8049-6fc1bbe2a080 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.590205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 454/913] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:35.592260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399ad8c-83c3-4b77-9b3f-1ec6eb4dfa87 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.592552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399ad8c-83c3-4b77-9b3f-1ec6eb4dfa87 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.592827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399ad8c-83c3-4b77-9b3f-1ec6eb4dfa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.603252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:35.604349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.604839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.605356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.609158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:35.613909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e399ad8c-83c3-4b77-9b3f-1ec6eb4dfa87 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:35.615225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e399ad8c-83c3-4b77-9b3f-1ec6eb4dfa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:35.617244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:35.619237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:35.633535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:35.634577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:35.635485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:35.635485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:35.635485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:35.635485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:35.635485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:35.635485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:35.635485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:35.635485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:35.638320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 460/914] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:35.645537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.701982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 455/915] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:35.724627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399ad8c-83c3-4b77-9b3f-1ec6eb4dfa87 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.790228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679acd-9c02-4ce0-b68e-102759b86978 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:35.793081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:35.825813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:35.826813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.827305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.827786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.829306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:35.829819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:35.831529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:35.845038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 461/916] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:35.857578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.860471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399ad8c-83c3-4b77-9b3f-1ec6eb4dfa87 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:35.899445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:35.900628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:35.901183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:35.901675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:35.902493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:35.904374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:35.914708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:35.915762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 00:16:35.916604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:35.919469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 456/917] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:35.925268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:35.932392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:35.987565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575ba43-ea66-493a-a3dc-5f1b9659d5ed None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:36.024247 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:36.025208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:36.025691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:36.026197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:36.027135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] RBAC: Adding query filter params (role.id=6500b899a635405583e8c8861c569559, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=ae7cde8433d046ec9cacb1665c03cd66) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:36.027673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:36.029285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:36.035668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 462/918] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:35 2022] GET /identity/v3/role_assignments?user.id=ae7cde8433d046ec9cacb1665c03cd66&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=6500b899a635405583e8c8861c569559 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:36.061221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a18c9-ca23-4c91-b424-3873ca94609c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:36.081518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:36.100128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:36.100758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:36.101051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:36.101323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:36.101950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:36.102307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:36.103723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:36.110292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 457/919] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:36.115863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:36.227548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d821b8-2cd4-44b6-bbf1-095ff2da8f22 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:36.248407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:36.263636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87daa4f-4aba-4f4f-aaca-ad80384ec04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:36.264245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87daa4f-4aba-4f4f-aaca-ad80384ec04b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:36.264526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87daa4f-4aba-4f4f-aaca-ad80384ec04b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:36.264798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87daa4f-4aba-4f4f-aaca-ad80384ec04b None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:36.265424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87daa4f-4aba-4f4f-aaca-ad80384ec04b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:36.265766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87daa4f-4aba-4f4f-aaca-ad80384ec04b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:36.267149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87daa4f-4aba-4f4f-aaca-ad80384ec04b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:36.272579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 463/920] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Aug 8 00:16:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:36.278303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:36.279856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ff90-40a4-48b1-a79a-6923abccd869 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:36.280213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ff90-40a4-48b1-a79a-6923abccd869 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:36.280556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ff90-40a4-48b1-a79a-6923abccd869 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:36.282127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 464/921] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:36.289219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453ea92-100a-47e2-b22a-c75544081659 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:36.289728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453ea92-100a-47e2-b22a-c75544081659 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:36.290267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453ea92-100a-47e2-b22a-c75544081659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:36.310527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-3453ea92-100a-47e2-b22a-c75544081659 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:36.312278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3453ea92-100a-47e2-b22a-c75544081659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:36.390133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f8a27-3e2c-4bcc-b25a-a15eb86287b0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:36.390826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 465/922] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:36.411690 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453ea92-100a-47e2-b22a-c75544081659 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:36.427344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd57112-0dd2-4a5d-b9df-7c47d469ed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:36.427907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57112-0dd2-4a5d-b9df-7c47d469ed36 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:36.428193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57112-0dd2-4a5d-b9df-7c47d469ed36 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:36.428471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57112-0dd2-4a5d-b9df-7c47d469ed36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:36.429390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd57112-0dd2-4a5d-b9df-7c47d469ed36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:36.430707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd57112-0dd2-4a5d-b9df-7c47d469ed36 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:36.460726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 458/923] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:16:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:36.536174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453ea92-100a-47e2-b22a-c75544081659 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:36.573095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:36.583950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c8d8-9f5a-4c95-b9c0-21ee819172b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:36.584567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c8d8-9f5a-4c95-b9c0-21ee819172b3 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:36.584898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c8d8-9f5a-4c95-b9c0-21ee819172b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:36.585177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c8d8-9f5a-4c95-b9c0-21ee819172b3 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:36.585817 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c8d8-9f5a-4c95-b9c0-21ee819172b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:36.587303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c8d8-9f5a-4c95-b9c0-21ee819172b3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:36.605363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 466/924] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:16:36 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:16:37.775557 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154048c6-cdde-4dd8-b268-8e13cc49308e None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:37.776062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154048c6-cdde-4dd8-b268-8e13cc49308e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:37.776170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154048c6-cdde-4dd8-b268-8e13cc49308e None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:37.777697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 459/925] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:37.782985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf621-480b-48fb-a948-02c93b33002b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:37.783379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf621-480b-48fb-a948-02c93b33002b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:37.783543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf621-480b-48fb-a948-02c93b33002b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:37.807177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a3abf621-480b-48fb-a948-02c93b33002b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:37.808366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a3abf621-480b-48fb-a948-02c93b33002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:37.891604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 467/926] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:37.914999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154048c6-cdde-4dd8-b268-8e13cc49308e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:37.957344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:38.020972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154048c6-cdde-4dd8-b268-8e13cc49308e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:38.056645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31289b-3a55-4211-88a7-0b0a40448cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:38.057251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31289b-3a55-4211-88a7-0b0a40448cc2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.057539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31289b-3a55-4211-88a7-0b0a40448cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.057817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31289b-3a55-4211-88a7-0b0a40448cc2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.058443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31289b-3a55-4211-88a7-0b0a40448cc2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:38.059817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31289b-3a55-4211-88a7-0b0a40448cc2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7a31289b-3a55-4211-88a7-0b0a40448cc2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:38.068738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:38.069784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:38.070737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 460/927] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:38.076265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abf621-480b-48fb-a948-02c93b33002b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:38.149782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2de684-5ea0-4a85-8224-c593aa3693c6 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.150099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2de684-5ea0-4a85-8224-c593aa3693c6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.150441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2de684-5ea0-4a85-8224-c593aa3693c6 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.152035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 461/928] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:38.159699 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43731-4c8f-4aaf-8249-9c6a5502538a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.160102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43731-4c8f-4aaf-8249-9c6a5502538a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.160489 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43731-4c8f-4aaf-8249-9c6a5502538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.175179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:38.181237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abf621-480b-48fb-a948-02c93b33002b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:38.182237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-bcf43731-4c8f-4aaf-8249-9c6a5502538a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:38.184256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-bcf43731-4c8f-4aaf-8249-9c6a5502538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:38.221527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:38.222419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.222797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.223127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.223764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] RBAC: Adding query filter params (name=compute) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:38.224065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:38.226562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:38.232805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 468/929] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:38.239072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:38.264797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 462/930] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:38.288884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf43731-4c8f-4aaf-8249-9c6a5502538a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:38.323321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:38.368776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5eb6-2dc2-4bac-b4a0-3e4d61cf71ab None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:38.401813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf43731-4c8f-4aaf-8249-9c6a5502538a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:38.413536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:38.414947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.415616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.416164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.416956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:38.417689 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:38.420024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:38.434536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 469/931] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:38.449021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6516f-a44c-4f04-a19a-531d0acf6c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:38.449810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6516f-a44c-4f04-a19a-531d0acf6c10 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.450116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6516f-a44c-4f04-a19a-531d0acf6c10 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.450441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6516f-a44c-4f04-a19a-531d0acf6c10 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.463546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6516f-a44c-4f04-a19a-531d0acf6c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-26b6516f-a44c-4f04-a19a-531d0acf6c10 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:38.468514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:38.470210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:38.471067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 463/932] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 00:16:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:38.479264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:38.508366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:38.595364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3567c-ce7f-4a9c-bc9e-141ee9ce161a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:38.635208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8bade-e38f-4b7a-b7f3-cb3caa9b9432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:38.635807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8bade-e38f-4b7a-b7f3-cb3caa9b9432 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.636083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8bade-e38f-4b7a-b7f3-cb3caa9b9432 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.636351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8bade-e38f-4b7a-b7f3-cb3caa9b9432 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.636999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8bade-e38f-4b7a-b7f3-cb3caa9b9432 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:38.637296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8bade-e38f-4b7a-b7f3-cb3caa9b9432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:38.638675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8bade-e38f-4b7a-b7f3-cb3caa9b9432 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:38.648278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 470/933] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 00:16:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:38.653998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6516f-a44c-4f04-a19a-531d0acf6c10 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:38.758197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:38.772530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6516f-a44c-4f04-a19a-531d0acf6c10 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:38.809383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:38.810842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.811346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.811836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.819607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1a5c7-d910-42f7-b9a8-d3869f406fe9 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.820111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1a5c7-d910-42f7-b9a8-d3869f406fe9 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.820205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1a5c7-d910-42f7-b9a8-d3869f406fe9 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.821877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 471/934] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:38.825790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:38.827167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965b88-e87b-4322-a0d1-1e84da6bd04e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.827451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965b88-e87b-4322-a0d1-1e84da6bd04e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.827726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965b88-e87b-4322-a0d1-1e84da6bd04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.828338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:38.847181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f1965b88-e87b-4322-a0d1-1e84da6bd04e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:38.847849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:38.848843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:38.849777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:38.849777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:38.849777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:38.849964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f1965b88-e87b-4322-a0d1-1e84da6bd04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:38.852543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 464/935] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:38.858318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:38.937524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 472/936] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:38.943367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cdaca-a65c-4c7d-9b92-261cdc6bd55c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.943657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cdaca-a65c-4c7d-9b92-261cdc6bd55c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.943932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cdaca-a65c-4c7d-9b92-261cdc6bd55c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.945325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 473/937] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:38.950629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fcc5d-3b70-4e66-b6ec-5439d66db865 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:38.950916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fcc5d-3b70-4e66-b6ec-5439d66db865 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:38.951197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fcc5d-3b70-4e66-b6ec-5439d66db865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:38.970190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-1f2fcc5d-3b70-4e66-b6ec-5439d66db865 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:38.971376 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1f2fcc5d-3b70-4e66-b6ec-5439d66db865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:38.982828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:38.985233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c2934-4de5-4de4-aa99-8d2a718cf866 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.021642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.022280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.022564 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.022839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.023496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:39.023808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.025176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.038481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 465/938] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:39.039659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.043425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:39.053504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 474/939] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:39.054503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fcc5d-3b70-4e66-b6ec-5439d66db865 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.151116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c76225-2b45-48ad-8a21-41b0c1d3c1f7 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.179308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fcc5d-3b70-4e66-b6ec-5439d66db865 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.187169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.187772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.188055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.188339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.188960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.190432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.193027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING keystone.server.flask.common [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 00:16:39.211385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.sql.core [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 00:16:39.211385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 00:16:39.211385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [parameters: {'id': '31da780ccd5145f5adfdd5a8a0f68933', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 00:16:39.211385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86589) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31da780ccd5145f5adfdd5a8a0f68933.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31da780ccd5145f5adfdd5a8a0f68933. Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application conn.query(q) Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 00:16:39.219312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application result.read() Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 08 00:16:39.220319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application next(self.gen) Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application yield resource Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application next(self.gen) Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise self.value Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application session.commit() Aug 08 00:16:39.221658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.session.flush() Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application compat.raise_( Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 00:16:39.222821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 00:16:39.223920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application conn.query(q) Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application result.read() Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 00:16:39.225302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [parameters: {'id': '31da780ccd5145f5adfdd5a8a0f68933', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.226442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:39.227401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31da780ccd5145f5adfdd5a8a0f68933. Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 466/940] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Aug 8 00:16:39 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:39.228530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.233229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.233229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.233229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.233229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.241359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.242834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:39.254964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:39.255924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:39.256872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:39.258783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 475/941] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:39.259806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.272299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:39.295983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:39.346771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38c1f-332e-406c-a20c-c7082af7b678 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.372042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaf2ab-0831-4199-857c-90fe24fadc13 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.382572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.383201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.383482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.383755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.384336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.385897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:39.395282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:39.396270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:39.397138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:39.401582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 467/942] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:39.402192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.413040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.413672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.413960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.414264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.421274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.422742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:39.434022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:39.435013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 476/943] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:39.436648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.517837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a9d67-301f-48e3-a646-1a9171b01b76 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.522721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:39.543165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:39.555979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.556585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.556865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.557134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.557861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:39.558194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.559643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.563460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3d7c-521c-48b1-8a5f-c0329408f4e2 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.582894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 468/944] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:39.584052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.606484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.607091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.607372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.607973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.608258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:39.608563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.609970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.614776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 477/945] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:39.615556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.694101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e48a-53e7-4b7a-a9ce-d4ab373da194 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.719540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f14cf-9487-4c25-ba69-e71fa8ff21aa None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.729099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.729699 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.729983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.730303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.730962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] RBAC: Adding query filter params (name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:39.731268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.732689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.749732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:39.757079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.758235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.758455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 469/946] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:39.758891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.759267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.760042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.772514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.774205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:39.791457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:39.792679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:39.793786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:39.793786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:39.793786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:39.795224 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 478/947] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:39.801768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.827450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:39.924771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dba42-2769-4edb-8921-ee37acecba2e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.948936 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c520ab-9eda-4804-ac68-8e348bbcdd67 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:39.965632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.968212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.968212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.968212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.968212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:39.968212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.969255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:39.974565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 470/948] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:39.980547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:39.993838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:39.994796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:39.994796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:39.995052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:39.995664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:39.995971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:39.997442 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:40.013051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 479/949] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:40.019116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:40.071904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:40.102178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef30791-b898-4861-85b9-8c860e07f58c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:40.110258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:40.131001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad6203-360f-42db-932a-7e45e70333a9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:40.141203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:40.142133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:40.142429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:40.142847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:40.143943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] RBAC: Adding query filter params (interface=public, service_id=53c74760cf384a32be84dd8258312241, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:40.144257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:40.146293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:40.153442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 471/950] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 00:16:39 2022] GET /identity/v3/endpoints?service_id=53c74760cf384a32be84dd8258312241&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:40.160033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:40.173986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:40.174858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:40.175212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:40.175748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:40.185377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:40.187850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:40.203151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:40.204063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:40.205468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:40.205468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:40.205468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:40.205468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:40.205468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:40.205468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:40.205468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:40.205468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:40.206575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 480/951] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:40.210499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:40.270492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddca493-f649-45ad-a873-6fc1faa1f317 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:40.308288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8f89a-4e29-4aef-81c0-c911e3c9a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:40.308931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f89a-4e29-4aef-81c0-c911e3c9a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:40.309264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f89a-4e29-4aef-81c0-c911e3c9a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:40.309544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f89a-4e29-4aef-81c0-c911e3c9a3a2 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:40.310178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8f89a-4e29-4aef-81c0-c911e3c9a3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:40.311554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8f89a-4e29-4aef-81c0-c911e3c9a3a2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:40.317972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27e2ae-a488-4ceb-acaa-c2eccd34f786 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:40.318265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 472/952] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:16:40 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:16:40.326817 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:40.368530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c1dfc-670e-48b5-b8dc-2353bcb502d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:40.369157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1dfc-670e-48b5-b8dc-2353bcb502d1 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:40.369442 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1dfc-670e-48b5-b8dc-2353bcb502d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:40.369721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1dfc-670e-48b5-b8dc-2353bcb502d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:40.370492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c1dfc-670e-48b5-b8dc-2353bcb502d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:40.370801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c1dfc-670e-48b5-b8dc-2353bcb502d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:40.372244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c1dfc-670e-48b5-b8dc-2353bcb502d1 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:40.387453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 481/953] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:40.393403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8f89a-4e29-4aef-81c0-c911e3c9a3a2 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:40.434376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:40.481678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddd57-055f-47db-9b32-aa3c24bc4f4e None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:40.482101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddd57-055f-47db-9b32-aa3c24bc4f4e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:40.482545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddd57-055f-47db-9b32-aa3c24bc4f4e None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:40.488838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 482/954] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:40.490223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf62310-85d4-4d9c-9a94-d597f706a4d0 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:40.490509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf62310-85d4-4d9c-9a94-d597f706a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:40.490779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf62310-85d4-4d9c-9a94-d597f706a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:40.510285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8f89a-4e29-4aef-81c0-c911e3c9a3a2 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:40.512027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-adf62310-85d4-4d9c-9a94-d597f706a4d0 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:40.513278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-adf62310-85d4-4d9c-9a94-d597f706a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:40.551769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19837c9-52ac-42a2-8eb7-1fe39e12794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:40.552432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19837c9-52ac-42a2-8eb7-1fe39e12794c None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:40.552714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19837c9-52ac-42a2-8eb7-1fe39e12794c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:40.552989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19837c9-52ac-42a2-8eb7-1fe39e12794c None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/ae7cde8433d046ec9cacb1665c03cd66/roles/6500b899a635405583e8c8861c569559` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:40.556082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19837c9-52ac-42a2-8eb7-1fe39e12794c None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=ae7cde8433d046ec9cacb1665c03cd66, role_id=6500b899a635405583e8c8861c569559)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:40.557710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19837c9-52ac-42a2-8eb7-1fe39e12794c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:40.577425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 473/955] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:40 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/ae7cde8433d046ec9cacb1665c03cd66/roles/6500b899a635405583e8c8861c569559 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:40.604833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 483/956] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:40.628701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19837c9-52ac-42a2-8eb7-1fe39e12794c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:40.741306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:40.749069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19837c9-52ac-42a2-8eb7-1fe39e12794c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:40.789368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e49121-1422-4b28-a3ba-da54fb9e4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:40.789976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49121-1422-4b28-a3ba-da54fb9e4221 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:40.790297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49121-1422-4b28-a3ba-da54fb9e4221 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:40.790572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49121-1422-4b28-a3ba-da54fb9e4221 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:40.791227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e49121-1422-4b28-a3ba-da54fb9e4221 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:40.792595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e49121-1422-4b28-a3ba-da54fb9e4221 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:40.817289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 474/957] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:16:40 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:42.008605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082efd62-2b88-4c8a-a525-7adc508c26c7 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.009225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082efd62-2b88-4c8a-a525-7adc508c26c7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.009225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082efd62-2b88-4c8a-a525-7adc508c26c7 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.010691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 484/958] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:42.016735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a18d2-b0b3-458b-9796-14f35e6e14c6 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.017558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a18d2-b0b3-458b-9796-14f35e6e14c6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.018355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a18d2-b0b3-458b-9796-14f35e6e14c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.037483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e22a18d2-b0b3-458b-9796-14f35e6e14c6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:42.039375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e22a18d2-b0b3-458b-9796-14f35e6e14c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:42.117454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 475/959] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:42.142356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082efd62-2b88-4c8a-a525-7adc508c26c7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:42.242055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:42.253957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082efd62-2b88-4c8a-a525-7adc508c26c7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:42.291072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:42.292027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.292538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.293041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.293899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:42.295563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:42.298472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING keystone.server.flask.common [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 00:16:42.311154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.sql.core [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 00:16:42.311154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 00:16:42.311154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [parameters: {'user_id': '4685b51e47f04fc8bb4b92fa7409542f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 00:16:42.311154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86588) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-d3bd8749-49c8-494b-a538-8631f993d8a0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application conn.query(q) Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application result.read() Aug 08 00:16:42.328805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 00:16:42.329783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application next(self.gen) Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application yield resource Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application next(self.gen) Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise self.value Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application session.commit() Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 00:16:42.330812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self.session.flush() Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application compat.raise_( Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 00:16:42.331802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 00:16:42.333844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application conn.query(q) Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application result.read() Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 00:16:42.335904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [parameters: {'user_id': '4685b51e47f04fc8bb4b92fa7409542f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:42.337975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 08 00:16:42.339998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 08 00:16:42.344350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 08 00:16:42.344350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 08 00:16:42.344350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 00:16:42.344350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 00:16:42.344350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 00:16:42.344350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:42.350165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 485/960] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Aug 8 00:16:42 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:42.352793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a18d2-b0b3-458b-9796-14f35e6e14c6 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:42.368374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2626d3-8d42-407e-b229-4b88abaf300c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.368544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2626d3-8d42-407e-b229-4b88abaf300c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.368822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2626d3-8d42-407e-b229-4b88abaf300c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.373245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 486/961] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:42.378697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde341c5-ce04-49a9-9b92-7f033304e4db None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.378981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde341c5-ce04-49a9-9b92-7f033304e4db None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.379251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde341c5-ce04-49a9-9b92-7f033304e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.404339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-dde341c5-ce04-49a9-9b92-7f033304e4db None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:42.406049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-dde341c5-ce04-49a9-9b92-7f033304e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:42.456428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:42.482261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a18d2-b0b3-458b-9796-14f35e6e14c6 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:42.490340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 487/962] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:42.510292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde341c5-ce04-49a9-9b92-7f033304e4db None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:42.520471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:42.521116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.521398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.521669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.531466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:42.533339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:42.547872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:42.548819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 00:16:42.549796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:42.552314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 476/963] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:42.566155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:42.618538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:42.639263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde341c5-ce04-49a9-9b92-7f033304e4db None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:42.667458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9ce4-9ab9-45fd-bff5-7a026b1f84fa None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:42.677622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:42.678437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.678821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.679193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.679874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:42.681467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:42.693705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:42.695004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:42.696022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 488/964] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:42.704013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:42.708707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06909770-3958-4c8d-8004-19467313a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:42.709317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909770-3958-4c8d-8004-19467313a15f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.709599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909770-3958-4c8d-8004-19467313a15f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.709873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909770-3958-4c8d-8004-19467313a15f None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.710664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909770-3958-4c8d-8004-19467313a15f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:42.711138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909770-3958-4c8d-8004-19467313a15f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:42.712589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909770-3958-4c8d-8004-19467313a15f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:42.740595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:42.754923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 477/965] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Aug 8 00:16:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:42.758102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5353-92a2-4a3b-8c25-07f6fcf5366e None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.758102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5353-92a2-4a3b-8c25-07f6fcf5366e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.758102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5353-92a2-4a3b-8c25-07f6fcf5366e None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.758102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 478/966] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:42.763918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824a0f8-4d2c-41e5-b250-ed30cb40fe80 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.764210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824a0f8-4d2c-41e5-b250-ed30cb40fe80 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.764493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824a0f8-4d2c-41e5-b250-ed30cb40fe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.784850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e824a0f8-4d2c-41e5-b250-ed30cb40fe80 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:42.786259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e824a0f8-4d2c-41e5-b250-ed30cb40fe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:42.828406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11a533-63a2-44fd-8820-d395c4957301 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:42.878360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 479/967] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:42.883632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:42.884604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:42.885091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:42.885566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:42.886441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:42.886948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:42.888651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:42.896300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824a0f8-4d2c-41e5-b250-ed30cb40fe80 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:42.898150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 489/968] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:42.905640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:42.932826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.022950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824a0f8-4d2c-41e5-b250-ed30cb40fe80 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.034911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eb581-b670-4ac8-a4e4-0315eda5acd7 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.050955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.059166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540139d-5988-4ca7-82a7-564d7fc418df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.059789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540139d-5988-4ca7-82a7-564d7fc418df None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.060070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540139d-5988-4ca7-82a7-564d7fc418df None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.060344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540139d-5988-4ca7-82a7-564d7fc418df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.068901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.069493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.069769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.070038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.070676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:43.070974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.071334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540139d-5988-4ca7-82a7-564d7fc418df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:43.072318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-a540139d-5988-4ca7-82a7-564d7fc418df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:43.076022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:43.076971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:43.077859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 480/969] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 00:16:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:43.078607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 490/970] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:43.079234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8222-6518-4107-83fe-5905e574a128 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.079526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8222-6518-4107-83fe-5905e574a128 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.079803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8222-6518-4107-83fe-5905e574a128 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.081190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 481/971] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:43.083029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.083149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8222-6518-4107-83fe-5905e574a128 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.158950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.182548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdb9dc-f037-420e-8bad-983122fbabb5 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.183917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8222-6518-4107-83fe-5905e574a128 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.215072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c87428-54d0-4da3-8c85-66f509c9a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.215679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c87428-54d0-4da3-8c85-66f509c9a84c None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.215961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c87428-54d0-4da3-8c85-66f509c9a84c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.216236 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c87428-54d0-4da3-8c85-66f509c9a84c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.216474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d6bc-1e13-4504-8021-3f02e64ea0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.216885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c87428-54d0-4da3-8c85-66f509c9a84c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.217071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d6bc-1e13-4504-8021-3f02e64ea0a2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.217354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d6bc-1e13-4504-8021-3f02e64ea0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.217631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d6bc-1e13-4504-8021-3f02e64ea0a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.218287 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c87428-54d0-4da3-8c85-66f509c9a84c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.218881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d6bc-1e13-4504-8021-3f02e64ea0a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:43.219134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d6bc-1e13-4504-8021-3f02e64ea0a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.220482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d6bc-1e13-4504-8021-3f02e64ea0a2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.228799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 482/972] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:43.229973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d0ff-beee-49f6-9ffd-7ca4d75a1193 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.230342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d0ff-beee-49f6-9ffd-7ca4d75a1193 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.230617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d0ff-beee-49f6-9ffd-7ca4d75a1193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.243591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 491/973] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:16:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:43.244605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c87428-54d0-4da3-8c85-66f509c9a84c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.255738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-6058d0ff-beee-49f6-9ffd-7ca4d75a1193 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:43.256968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6058d0ff-beee-49f6-9ffd-7ca4d75a1193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:43.310812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.342326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 483/974] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:43.366878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d0ff-beee-49f6-9ffd-7ca4d75a1193 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.371051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c87428-54d0-4da3-8c85-66f509c9a84c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.404497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.410140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.410922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.411781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.413016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.428097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.429557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:43.443801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:43.444869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:43.445769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:43.445769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:43.445769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:43.445769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 492/975] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:43.450533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.478821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d0ff-beee-49f6-9ffd-7ca4d75a1193 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.516869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.517503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.517782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.518343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.518925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.520298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:43.528899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:43.529873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:43.531687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 484/976] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:43.536356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.566778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65afa1-1423-4452-be14-0776a9dc24cd None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.581408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.605692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.606430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.606614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.606886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.607523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:43.607827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.609217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.622365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 493/977] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:43.627919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.647692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b76117-6891-4b44-8ce9-591f27eb29f1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.677265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.689981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.690416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.690693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.690968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.691644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:43.691943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.693301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.697991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 485/978] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:43.704012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.740289 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bedc96-8b2a-4caf-a8f9-47c4f0c3614e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.777424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.778049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.778407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.778679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.786491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.787920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:43.799560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:43.800565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:43.801565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 494/979] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:43.806331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.818135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ee4a7-966e-402d-88e0-a49364e340bd None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.821356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.865220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.866159 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.866450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.866995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.867637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] RBAC: Adding query filter params (type=compute) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:43.868144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.869784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.881145 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 486/980] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:43.882394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.909526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9fe7-96a2-42a9-a7aa-0cd71e1cd676 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:43.913322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:43.950160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:43.950713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:43.950993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:43.951266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:43.951985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:43.952290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:43.954359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:43.972296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 495/981] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:43.977590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:43.996242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ae951-3864-4ae6-8b9e-3080ece6ebfe None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:44.032181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:44.032813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:44.033057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:44.033329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:44.034049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] RBAC: Adding query filter params (interface=public, service_id=e524dd65f04b4cd6a9abed9d43c6f19b, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:44.034869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:44.036502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:44.046221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 487/982] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/endpoints?service_id=e524dd65f04b4cd6a9abed9d43c6f19b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:44.048644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:44.080836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:44.090624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab5a2-2a61-49e5-9a7c-bfcbc58fc27a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:44.125455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9221898-bb9e-43ab-81e1-6a2291e6e699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:44.126173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9221898-bb9e-43ab-81e1-6a2291e6e699 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:44.126372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9221898-bb9e-43ab-81e1-6a2291e6e699 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:44.126646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9221898-bb9e-43ab-81e1-6a2291e6e699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:44.155346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915273aa-41d2-4f17-b081-3d37d5bb37b1 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:44.158748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:44.193907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a7a70-0118-4e07-a405-36a828cf0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:44.195104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7a70-0118-4e07-a405-36a828cf0b02 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:44.195393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7a70-0118-4e07-a405-36a828cf0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:44.195666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7a70-0118-4e07-a405-36a828cf0b02 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:44.196549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a7a70-0118-4e07-a405-36a828cf0b02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:44.196762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9221898-bb9e-43ab-81e1-6a2291e6e699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:44.197924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a7a70-0118-4e07-a405-36a828cf0b02 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:44.198208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9221898-bb9e-43ab-81e1-6a2291e6e699 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:44.205784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 488/983] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:16:44 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:16:44.307329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 496/984] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:43 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 00:16:44.313704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a7a70-0118-4e07-a405-36a828cf0b02 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:44.413656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:44.420537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a7a70-0118-4e07-a405-36a828cf0b02 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:44.456178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:44.456786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:44.457066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:44.457335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:44.467502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:44.468977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:44.483448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:44.484997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:44.485887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:44.485887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:44.485887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:44.485887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 489/985] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:44.490740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9221898-bb9e-43ab-81e1-6a2291e6e699 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:44.552216 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:44.591509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9221898-bb9e-43ab-81e1-6a2291e6e699 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:44.627568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:44.628312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:44.628710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:44.629111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:44.629836 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:44.630268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:44.631714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:44.647648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 497/986] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:44.648987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:44.751132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d21ff-2325-45e9-bc33-5cd283abfc2d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:44.784131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:44.784756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:44.785034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:44.785306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:44.791826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:44.793259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:44.805999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:44.806955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:44.807870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 490/987] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:44.812928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:44.924605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dee42-caf6-49ae-881c-cf75272afbbe None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:44.947163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:44.959660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e0c6-0769-4da4-afea-1b894c68db13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:44.960275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e0c6-0769-4da4-afea-1b894c68db13 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:44.960555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e0c6-0769-4da4-afea-1b894c68db13 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:44.960826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e0c6-0769-4da4-afea-1b894c68db13 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:44.961511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e0c6-0769-4da4-afea-1b894c68db13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:44.961817 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e0c6-0769-4da4-afea-1b894c68db13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:44.963260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e0c6-0769-4da4-afea-1b894c68db13 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:44.976201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 498/988] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:44.983497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:44.995419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:45.088979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b6fb7-d54e-4d15-9c7d-163bfc0130da None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:45.124641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187ad98-b893-4527-87fe-657c5a80c54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:45.125265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ad98-b893-4527-87fe-657c5a80c54a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:45.125544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ad98-b893-4527-87fe-657c5a80c54a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:45.125866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ad98-b893-4527-87fe-657c5a80c54a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:45.126630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187ad98-b893-4527-87fe-657c5a80c54a None admin] RBAC: Adding query filter params (role.id=6500b899a635405583e8c8861c569559, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=ae7cde8433d046ec9cacb1665c03cd66) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:45.126942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187ad98-b893-4527-87fe-657c5a80c54a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:45.128508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187ad98-b893-4527-87fe-657c5a80c54a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:45.142167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 491/989] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:44 2022] GET /identity/v3/role_assignments?user.id=ae7cde8433d046ec9cacb1665c03cd66&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=6500b899a635405583e8c8861c569559 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:45.342441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4b98-92bd-444c-b2c2-994a732308e6 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:45.342971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4b98-92bd-444c-b2c2-994a732308e6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:45.342971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4b98-92bd-444c-b2c2-994a732308e6 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:45.344849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 499/990] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:45.350602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5862a-48df-4350-b38d-17dcded0f6da None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:45.350892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5862a-48df-4350-b38d-17dcded0f6da None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:45.351166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5862a-48df-4350-b38d-17dcded0f6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:45.368822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-dcb5862a-48df-4350-b38d-17dcded0f6da None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:45.369992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dcb5862a-48df-4350-b38d-17dcded0f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:45.439079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 492/991] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:45.462222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4b98-92bd-444c-b2c2-994a732308e6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:45.565334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4b98-92bd-444c-b2c2-994a732308e6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:45.598960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:45.599506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:45.599832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:45.600137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:45.600709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:45.602051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:45.610641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:45.611637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:45.612500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:45.614188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 500/992] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:45.619717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5862a-48df-4350-b38d-17dcded0f6da None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:45.620009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:45.718035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5862a-48df-4350-b38d-17dcded0f6da None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:45.752466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:45.753070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:45.753348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:45.753804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:45.754477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:45.754781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:45.756336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:45.766461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 493/993] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:45.767308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:45.815312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:45.878054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a29156-7f5c-46df-9307-6411884082f0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:45.911406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:45.912149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:45.912546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:45.912913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:45.913626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:45.914027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:45.915487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:45.925580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 501/994] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:45.927102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:45.995730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:46.032639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3d5a4-b3a7-4668-88fa-530bf6228477 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:46.066867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3645360-cc37-4059-8819-8408f7244aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:46.067474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3645360-cc37-4059-8819-8408f7244aca None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:46.067755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3645360-cc37-4059-8819-8408f7244aca None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:46.068031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3645360-cc37-4059-8819-8408f7244aca None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:46.068739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3645360-cc37-4059-8819-8408f7244aca None admin] RBAC: Adding query filter params (interface=admin, service_id=53c74760cf384a32be84dd8258312241, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:46.069048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3645360-cc37-4059-8819-8408f7244aca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:46.070657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3645360-cc37-4059-8819-8408f7244aca None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:46.080787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 494/995] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Aug 8 00:16:45 2022] GET /identity/v3/endpoints?service_id=53c74760cf384a32be84dd8258312241&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:46.082291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:46.185015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64ae77-fff0-4920-93d8-0e498180a354 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:46.195121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:46.221572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e468e-c0d9-4e24-8ce7-d901d4496476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:46.222090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e468e-c0d9-4e24-8ce7-d901d4496476 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:46.222384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e468e-c0d9-4e24-8ce7-d901d4496476 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:46.222656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e468e-c0d9-4e24-8ce7-d901d4496476 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:46.223257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e468e-c0d9-4e24-8ce7-d901d4496476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:46.224610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e468e-c0d9-4e24-8ce7-d901d4496476 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:46.238146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 502/996] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:16:46 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:16:46.253592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394685-d4af-4655-82fe-fe6ab904aacf None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:46.254148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394685-d4af-4655-82fe-fe6ab904aacf None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:46.254232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394685-d4af-4655-82fe-fe6ab904aacf None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:46.255770 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 495/997] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:46.261583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167b7b9-3bcb-4199-983b-daece9d2bd9b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:46.261939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167b7b9-3bcb-4199-983b-daece9d2bd9b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:46.262177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167b7b9-3bcb-4199-983b-daece9d2bd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:46.282179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b167b7b9-3bcb-4199-983b-daece9d2bd9b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:46.283396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b167b7b9-3bcb-4199-983b-daece9d2bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:46.357008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 503/998] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:46.379905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394685-d4af-4655-82fe-fe6ab904aacf None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:46.490925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394685-d4af-4655-82fe-fe6ab904aacf None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:46.519614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:46.526558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:46.527188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:46.527469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:46.527749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:46.528319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:46.529685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:46.538910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:46.539898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:46.540771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 496/999] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:46.546229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167b7b9-3bcb-4199-983b-daece9d2bd9b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:46.644335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167b7b9-3bcb-4199-983b-daece9d2bd9b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:46.646690 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:46.678928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:46.679538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:46.679816 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:46.680084 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:46.680702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:46.681009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:46.682385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:46.687526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 504/1000] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:46.692824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:46.793111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1353-6727-4b6d-8bf6-00a0ba32a7f9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:46.825983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7df816-b389-42d3-86c7-0efb67c7f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:46.826610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7df816-b389-42d3-86c7-0efb67c7f97f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:46.826894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7df816-b389-42d3-86c7-0efb67c7f97f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:46.827164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7df816-b389-42d3-86c7-0efb67c7f97f None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:46.828305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7df816-b389-42d3-86c7-0efb67c7f97f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:46.828605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7df816-b389-42d3-86c7-0efb67c7f97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:46.829964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7df816-b389-42d3-86c7-0efb67c7f97f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:46.839426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 497/1001] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Aug 8 00:16:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:46.840668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:46.950775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934604d-683f-428c-8909-dcd315a92026 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:46.985584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd1468-bd55-44b5-a960-2db445de1488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:46.986210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd1468-bd55-44b5-a960-2db445de1488 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:46.986491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd1468-bd55-44b5-a960-2db445de1488 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:46.986761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd1468-bd55-44b5-a960-2db445de1488 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:46.987405 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd1468-bd55-44b5-a960-2db445de1488 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:46.988779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd1468-bd55-44b5-a960-2db445de1488 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:47.010301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 505/1002] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:16:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:47.197645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe28b-7f96-4169-aaf4-67b93d142b18 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:47.197852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe28b-7f96-4169-aaf4-67b93d142b18 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:47.198152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe28b-7f96-4169-aaf4-67b93d142b18 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:47.199501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 498/1003] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:47.205557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e14bf-80de-471d-9557-9452cb9b04b9 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:47.205848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e14bf-80de-471d-9557-9452cb9b04b9 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:47.206159 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e14bf-80de-471d-9557-9452cb9b04b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:47.224799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-958e14bf-80de-471d-9557-9452cb9b04b9 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:47.226303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-958e14bf-80de-471d-9557-9452cb9b04b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:47.245034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:47.305153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 506/1004] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:47 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:47.327762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe28b-7f96-4169-aaf4-67b93d142b18 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:47.389049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:47.433436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe28b-7f96-4169-aaf4-67b93d142b18 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:47.467441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:47.468184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:47.468536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:47.468885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] PATH_INFO: `/v3/services/image` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:47.469547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:47.471062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:47.480504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:47.481514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:47.487841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 499/1005] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 8 00:16:47 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:47.490274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e14bf-80de-471d-9557-9452cb9b04b9 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:47.592357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e14bf-80de-471d-9557-9452cb9b04b9 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:47.626682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8cffe-d3ab-4605-a61b-7fb8d5fa3e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:47.627282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8cffe-d3ab-4605-a61b-7fb8d5fa3e93 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:47.627561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8cffe-d3ab-4605-a61b-7fb8d5fa3e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:47.627830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8cffe-d3ab-4605-a61b-7fb8d5fa3e93 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:47.628443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8cffe-d3ab-4605-a61b-7fb8d5fa3e93 None admin] RBAC: Adding query filter params (name=image) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:47.628743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8cffe-d3ab-4605-a61b-7fb8d5fa3e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:47.630153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8cffe-d3ab-4605-a61b-7fb8d5fa3e93 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:47.639541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 507/1006] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:47.640768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:47.743358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7179886-6a9b-41e9-a7f5-ab64937da0fd None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:47.765527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:47.778614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd006c8-cf28-4c10-b68a-402b5f487c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:47.779219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd006c8-cf28-4c10-b68a-402b5f487c66 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:47.779508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd006c8-cf28-4c10-b68a-402b5f487c66 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:47.779759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd006c8-cf28-4c10-b68a-402b5f487c66 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:47.780387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd006c8-cf28-4c10-b68a-402b5f487c66 None admin] RBAC: Adding query filter params (type=image) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:47.782276 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd006c8-cf28-4c10-b68a-402b5f487c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:47.783685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd006c8-cf28-4c10-b68a-402b5f487c66 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:47.788453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 500/1007] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:48.246329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0a49a-b988-44e8-8769-65a061a894df None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:48.246709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0a49a-b988-44e8-8769-65a061a894df None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:48.246889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0a49a-b988-44e8-8769-65a061a894df None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:48.248279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 508/1008] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:48.253567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a3e2-bd6a-40bf-91cd-d354a6c07c2a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:48.253924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a3e2-bd6a-40bf-91cd-d354a6c07c2a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:48.254306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a3e2-bd6a-40bf-91cd-d354a6c07c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:48.272882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-37f7a3e2-bd6a-40bf-91cd-d354a6c07c2a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:48.274050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-37f7a3e2-bd6a-40bf-91cd-d354a6c07c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:48.342119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 501/1009] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:48 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:48.363717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0a49a-b988-44e8-8769-65a061a894df None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:48.380770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:48.476790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0a49a-b988-44e8-8769-65a061a894df None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:48.511774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:48.512356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:48.512596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:48.512872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:48.513452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:48.514840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:48.524508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:48.525483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 00:16:48.526834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:48.530144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 509/1010] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Aug 8 00:16:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:48.531886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7a3e2-bd6a-40bf-91cd-d354a6c07c2a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:48.631461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7a3e2-bd6a-40bf-91cd-d354a6c07c2a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:48.648557 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:48.666890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:48.667495 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:48.667773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:48.668042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:48.668664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:48.668964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:48.670409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:48.679807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 502/1011] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:48.681308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:48.765343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:48.789069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32cc6c-e424-49b5-b7b3-ae44cfac2145 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:48.824960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c87160-d2e1-4cc5-a7a4-db156edeb834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:48.825667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c87160-d2e1-4cc5-a7a4-db156edeb834 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:48.825947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c87160-d2e1-4cc5-a7a4-db156edeb834 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:48.826245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c87160-d2e1-4cc5-a7a4-db156edeb834 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:48.826859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c87160-d2e1-4cc5-a7a4-db156edeb834 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:48.827155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c87160-d2e1-4cc5-a7a4-db156edeb834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:48.828524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c87160-d2e1-4cc5-a7a4-db156edeb834 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:48.838252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 510/1012] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Aug 8 00:16:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:48.839496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:48.951837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dade574-f6f2-42d8-beff-21b0ca3cfb53 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:48.986325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf20c-3431-4d92-97d3-c0a01545e012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:48.986933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf20c-3431-4d92-97d3-c0a01545e012 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:48.987214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf20c-3431-4d92-97d3-c0a01545e012 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:48.987488 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf20c-3431-4d92-97d3-c0a01545e012 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:48.988147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15caf20c-3431-4d92-97d3-c0a01545e012 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:48.989542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15caf20c-3431-4d92-97d3-c0a01545e012 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:49.007355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 503/1013] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:16:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:16:49.131328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b2a90-5d9b-46ee-aed6-ea414b38a2d9 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:49.131642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b2a90-5d9b-46ee-aed6-ea414b38a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:49.131829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b2a90-5d9b-46ee-aed6-ea414b38a2d9 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:49.133349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 511/1014] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:49.138766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad35a5-a8f5-4f38-b5da-9d0720d21b64 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:49.139066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad35a5-a8f5-4f38-b5da-9d0720d21b64 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:49.139340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad35a5-a8f5-4f38-b5da-9d0720d21b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:49.158707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f6ad35a5-a8f5-4f38-b5da-9d0720d21b64 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:49.160214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f6ad35a5-a8f5-4f38-b5da-9d0720d21b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:49.198756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:49.240294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 504/1015] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:49 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:49.263345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b2a90-5d9b-46ee-aed6-ea414b38a2d9 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:49.367692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b2a90-5d9b-46ee-aed6-ea414b38a2d9 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:49.401678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de33e8-50aa-4880-88e2-f8d62814aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:49.402275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de33e8-50aa-4880-88e2-f8d62814aac6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:49.402559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de33e8-50aa-4880-88e2-f8d62814aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:49.402829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de33e8-50aa-4880-88e2-f8d62814aac6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:49.413922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de33e8-50aa-4880-88e2-f8d62814aac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-15de33e8-50aa-4880-88e2-f8d62814aac6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:49.418692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:49.419616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:49.420467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:49.422221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 512/1016] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 00:16:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:49.426614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad35a5-a8f5-4f38-b5da-9d0720d21b64 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:49.530652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad35a5-a8f5-4f38-b5da-9d0720d21b64 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:49.567262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:49.567861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:49.568138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:49.568407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:49.569058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:49.569355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:49.570836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:49.584068 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 505/1017] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 00:16:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:49.585240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de33e8-50aa-4880-88e2-f8d62814aac6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:49.588170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:49.686607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de33e8-50aa-4880-88e2-f8d62814aac6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:49.720469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09de53-c839-4a3a-8676-955347adc4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:49.721093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09de53-c839-4a3a-8676-955347adc4d7 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:49.721379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09de53-c839-4a3a-8676-955347adc4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:49.721644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09de53-c839-4a3a-8676-955347adc4d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:49.732076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09de53-c839-4a3a-8676-955347adc4d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:49.733497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09de53-c839-4a3a-8676-955347adc4d7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-ed09de53-c839-4a3a-8676-955347adc4d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:49.747409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:49.748371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:49.749305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:49.749305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:49.749305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:49.749305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 513/1018] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:49.756665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:49.781694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c65e80-24bd-4d9b-8c1c-c31a95831de2 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:49.781973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c65e80-24bd-4d9b-8c1c-c31a95831de2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:49.782275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c65e80-24bd-4d9b-8c1c-c31a95831de2 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:49.783609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 514/1019] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:49.785291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:49.789057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1ca75-3f13-4617-a733-bad980b71a19 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:49.789369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1ca75-3f13-4617-a733-bad980b71a19 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:49.789637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1ca75-3f13-4617-a733-bad980b71a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:49.809587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b2e1ca75-3f13-4617-a733-bad980b71a19 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:49.810818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b2e1ca75-3f13-4617-a733-bad980b71a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:49.865465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:49.868072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d44ab-4085-4c55-b101-27c03f3a82ce None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:49.885208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 515/1020] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:49 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:49.906629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:49.907355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:49.907612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:49.907881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:49.908244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1ca75-3f13-4617-a733-bad980b71a19 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:49.908574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:49.908878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:49.910315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:49.927969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 506/1021] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:49.929014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:50.015166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1ca75-3f13-4617-a733-bad980b71a19 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:50.024442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:50.040951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ca5d-5637-4fdc-8614-cd73bb5167bf None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:50.053128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697383f6-78cd-4267-b13f-f906f1ef074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:50.053740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697383f6-78cd-4267-b13f-f906f1ef074a None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:50.054022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697383f6-78cd-4267-b13f-f906f1ef074a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:50.054325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697383f6-78cd-4267-b13f-f906f1ef074a None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:50.054998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697383f6-78cd-4267-b13f-f906f1ef074a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:50.056358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697383f6-78cd-4267-b13f-f906f1ef074a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:50.071915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 516/1022] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:16:49 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:16:50.086968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:50.087698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:50.088011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:50.088282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:50.097409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:50.098948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:50.112657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:50.113689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:50.115201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 507/1023] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:16:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:50.122243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697383f6-78cd-4267-b13f-f906f1ef074a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:50.175718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:50.241124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697383f6-78cd-4267-b13f-f906f1ef074a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:50.277964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:50.278538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:50.278826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:50.279101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:50.279821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:50.280127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:50.282135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:50.304096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 517/1024] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:16:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:50.305651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:50.406359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666cfe-7d24-4c9d-aa9c-980923170124 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:50.439092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da2a0-4e28-4d79-872e-5e289e56efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:50.439702 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da2a0-4e28-4d79-872e-5e289e56efea None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:50.439970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da2a0-4e28-4d79-872e-5e289e56efea None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:50.440211 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da2a0-4e28-4d79-872e-5e289e56efea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:50.455513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:50.510130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6da2a0-4e28-4d79-872e-5e289e56efea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:50.511584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6da2a0-4e28-4d79-872e-5e289e56efea None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:50.612401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 508/1025] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:16:50.617955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:50.719558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9cb2-c7a0-461b-8d7d-df3ac9c598da None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:50.721504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:50.756061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:50.756679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:50.756953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:50.757219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:50.767631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:50.769315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:50.783711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:50.784717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:50.785618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:50.785618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:50.785618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:50.789658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 518/1026] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:50.791103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da2a0-4e28-4d79-872e-5e289e56efea None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:50.838531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:50.900777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da2a0-4e28-4d79-872e-5e289e56efea None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:50.935679 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ebde4-ff7a-470a-9ef1-ad45f26267b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:50.936282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ebde4-ff7a-470a-9ef1-ad45f26267b6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:50.936564 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ebde4-ff7a-470a-9ef1-ad45f26267b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:50.937336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ebde4-ff7a-470a-9ef1-ad45f26267b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:50.937977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ebde4-ff7a-470a-9ef1-ad45f26267b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:50.938315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ebde4-ff7a-470a-9ef1-ad45f26267b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:50.939763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ebde4-ff7a-470a-9ef1-ad45f26267b6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:50.956065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 509/1027] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:50.958378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:51.035711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e5ca-cbfc-4405-aa75-d99f9a96d671 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:51.036090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e5ca-cbfc-4405-aa75-d99f9a96d671 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:51.036281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e5ca-cbfc-4405-aa75-d99f9a96d671 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:51.038234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 510/1028] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:51.043173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907a029-8c8f-4dd9-818c-b6486cc7249f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:51.043468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907a029-8c8f-4dd9-818c-b6486cc7249f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:51.043736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907a029-8c8f-4dd9-818c-b6486cc7249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:51.062923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d907a029-8c8f-4dd9-818c-b6486cc7249f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:51.063976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f34a93-6871-4b85-8a83-3064db2b047a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:51.064152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d907a029-8c8f-4dd9-818c-b6486cc7249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:51.100279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:51.101096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:51.101389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:51.101660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:51.108532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:51.110489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:51.121703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:51.122629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:51.124964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 519/1029] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:51.129248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:51.141959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 511/1030] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:51.147013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:51.165327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907a029-8c8f-4dd9-818c-b6486cc7249f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:51.204875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:51.241280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e390b1-ff0b-4a0e-aa52-334e6407a084 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:51.277494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907a029-8c8f-4dd9-818c-b6486cc7249f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:51.280881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:51.281487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:51.281770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:51.282044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:51.282757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:51.283062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:51.284492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:51.297995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 520/1031] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:51.304323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:51.315633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960b6b-dbae-4ac7-843b-2e9ae16d090c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:51.316578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960b6b-dbae-4ac7-843b-2e9ae16d090c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:51.316865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960b6b-dbae-4ac7-843b-2e9ae16d090c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:51.317319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960b6b-dbae-4ac7-843b-2e9ae16d090c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:51.318429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960b6b-dbae-4ac7-843b-2e9ae16d090c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:51.319865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960b6b-dbae-4ac7-843b-2e9ae16d090c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:51.321591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 512/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:51.327172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960b6b-dbae-4ac7-843b-2e9ae16d090c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:51.386880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:51.417910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d77bc-c36a-4015-99eb-2bfaabf63c68 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:51.434896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960b6b-dbae-4ac7-843b-2e9ae16d090c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:51.436408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:51.454557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc54546-5e4b-475f-8dd4-03f5d2206343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:51.455380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc54546-5e4b-475f-8dd4-03f5d2206343 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:51.455503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc54546-5e4b-475f-8dd4-03f5d2206343 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:51.455686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc54546-5e4b-475f-8dd4-03f5d2206343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:51.456402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc54546-5e4b-475f-8dd4-03f5d2206343 None admin] RBAC: Adding query filter params (role.id=6500b899a635405583e8c8861c569559, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=fe6573439abd4afb8098390eb4c7e5ef) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:51.456711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc54546-5e4b-475f-8dd4-03f5d2206343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:51.458235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc54546-5e4b-475f-8dd4-03f5d2206343 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:51.466102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 521/1033] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:51 2022] GET /identity/v3/role_assignments?user.id=fe6573439abd4afb8098390eb4c7e5ef&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=6500b899a635405583e8c8861c569559 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:51.481776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b67740-df67-42c1-936e-5bf44d52276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:51.482446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67740-df67-42c1-936e-5bf44d52276c None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:51.482867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67740-df67-42c1-936e-5bf44d52276c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:51.483208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67740-df67-42c1-936e-5bf44d52276c None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:51.484616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b67740-df67-42c1-936e-5bf44d52276c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:51.486210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b67740-df67-42c1-936e-5bf44d52276c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:51.516718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 513/1034] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:16:51 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:16:52.099668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9cf2-0e72-4a05-88e4-48f01ce42ae6 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:52.100180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9cf2-0e72-4a05-88e4-48f01ce42ae6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:52.100291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9cf2-0e72-4a05-88e4-48f01ce42ae6 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:52.101699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 522/1035] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:52.106850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae52fb8-5f4f-4b57-b9ec-9b7212c05424 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:52.107142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae52fb8-5f4f-4b57-b9ec-9b7212c05424 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:52.107418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae52fb8-5f4f-4b57-b9ec-9b7212c05424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:52.125966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-cae52fb8-5f4f-4b57-b9ec-9b7212c05424 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:52.127099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cae52fb8-5f4f-4b57-b9ec-9b7212c05424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:52.195219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 514/1036] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:52.217251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada9cf2-0e72-4a05-88e4-48f01ce42ae6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:52.318208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada9cf2-0e72-4a05-88e4-48f01ce42ae6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:52.351456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:52.352066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:52.352341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:52.352608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] PATH_INFO: `/v3/services/image` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:52.353170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:52.354539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:52.362884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:52.363857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:52.364734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:52.366438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 523/1037] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 8 00:16:52 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:52.369865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae52fb8-5f4f-4b57-b9ec-9b7212c05424 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:52.455989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:52.474263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae52fb8-5f4f-4b57-b9ec-9b7212c05424 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:52.508803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:52.509418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:52.509680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:52.509926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:52.510581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:52.510880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:52.512239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:52.521958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 515/1038] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:52.523215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:52.528589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:52.629650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9db3-7454-45cd-b811-e5eb5bfcac83 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:52.664418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:52.665037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:52.665463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:52.665748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:52.666430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] RBAC: Adding query filter params (type=image) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:52.666741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:52.668184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:52.674938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 524/1039] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:52.680672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:52.781770 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c7226-ea19-41a2-a992-a6dbb144c5e3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:52.816663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2a391-1ffc-432d-a3c2-f0ffeaca6c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:52.817268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2a391-1ffc-432d-a3c2-f0ffeaca6c75 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:52.817549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2a391-1ffc-432d-a3c2-f0ffeaca6c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:52.817822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2a391-1ffc-432d-a3c2-f0ffeaca6c75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:52.818550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2a391-1ffc-432d-a3c2-f0ffeaca6c75 None admin] RBAC: Adding query filter params (interface=public, service_id=d9eaa7102af04f519503142e94d73421, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:52.818857 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2a391-1ffc-432d-a3c2-f0ffeaca6c75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:52.820216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2a391-1ffc-432d-a3c2-f0ffeaca6c75 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:52.825378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 516/1040] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 00:16:52 2022] GET /identity/v3/endpoints?service_id=d9eaa7102af04f519503142e94d73421&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:52.830766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:52.903703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:52.948520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127855de-bfa2-4f45-909c-e2232c87a2b3 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:52.981903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597b9d8-e81d-40f0-b29f-8b9d2c04761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:52.982538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b9d8-e81d-40f0-b29f-8b9d2c04761a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:52.982819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b9d8-e81d-40f0-b29f-8b9d2c04761a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:52.983090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b9d8-e81d-40f0-b29f-8b9d2c04761a None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:52.984315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597b9d8-e81d-40f0-b29f-8b9d2c04761a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:52.985659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597b9d8-e81d-40f0-b29f-8b9d2c04761a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:52.992406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 525/1041] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:16:52 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:16:53.509024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a392bb-42fc-4589-a75a-197313b32224 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:53.509560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a392bb-42fc-4589-a75a-197313b32224 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:53.509560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a392bb-42fc-4589-a75a-197313b32224 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:53.511133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 517/1042] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:53.516071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307d09-c1fd-4526-98bb-d8938ce6dbc6 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:53.516452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307d09-c1fd-4526-98bb-d8938ce6dbc6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:53.516622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307d09-c1fd-4526-98bb-d8938ce6dbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:53.534717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-47307d09-c1fd-4526-98bb-d8938ce6dbc6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:53.535909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-47307d09-c1fd-4526-98bb-d8938ce6dbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:53.565477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd469-759f-48ef-a205-3bc162ea9c5e None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:53.565854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd469-759f-48ef-a205-3bc162ea9c5e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:53.566036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd469-759f-48ef-a205-3bc162ea9c5e None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:53.567502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 518/1043] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:53.572011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeece3c0-af45-43ef-ab34-46ca9e2173c8 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:53.572292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeece3c0-af45-43ef-ab34-46ca9e2173c8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:53.572563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeece3c0-af45-43ef-ab34-46ca9e2173c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:53.589824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-aeece3c0-af45-43ef-ab34-46ca9e2173c8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:53.591035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-aeece3c0-af45-43ef-ab34-46ca9e2173c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:53.598301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:53.611311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 526/1044] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:53.634139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47307d09-c1fd-4526-98bb-d8938ce6dbc6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:53.666001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 519/1045] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:53.690344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeece3c0-af45-43ef-ab34-46ca9e2173c8 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:53.701070 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:53.747698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47307d09-c1fd-4526-98bb-d8938ce6dbc6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:53.785770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73c3eb-8bf4-4db7-aa37-681b36fb69b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:53.786371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73c3eb-8bf4-4db7-aa37-681b36fb69b1 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:53.786636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73c3eb-8bf4-4db7-aa37-681b36fb69b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:53.786911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73c3eb-8bf4-4db7-aa37-681b36fb69b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:53.790962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeece3c0-af45-43ef-ab34-46ca9e2173c8 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:53.798049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73c3eb-8bf4-4db7-aa37-681b36fb69b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-aa73c3eb-8bf4-4db7-aa37-681b36fb69b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:53.803197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:53.804106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:53.804948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 527/1046] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 00:16:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:53.810489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73c3eb-8bf4-4db7-aa37-681b36fb69b1 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:53.827658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ea814-b742-411d-a49e-9414f1a28a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:53.828362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ea814-b742-411d-a49e-9414f1a28a79 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:53.828647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ea814-b742-411d-a49e-9414f1a28a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:53.828920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ea814-b742-411d-a49e-9414f1a28a79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:53.830016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ea814-b742-411d-a49e-9414f1a28a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:53.831497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ea814-b742-411d-a49e-9414f1a28a79 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:53.833051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 520/1047] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:53.838532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ea814-b742-411d-a49e-9414f1a28a79 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:53.852468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:53.924900 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73c3eb-8bf4-4db7-aa37-681b36fb69b1 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:53.944768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:53.950447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ea814-b742-411d-a49e-9414f1a28a79 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:53.960678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:53.961302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:53.961607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:53.961910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:53.962882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:53.963186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:53.964688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:53.973934 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 528/1048] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 00:16:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:53.979887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:53.988247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2993b-c6b5-4045-8832-ae2a90afca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:53.988848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2993b-c6b5-4045-8832-ae2a90afca8f None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:53.989141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2993b-c6b5-4045-8832-ae2a90afca8f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:53.989396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2993b-c6b5-4045-8832-ae2a90afca8f None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:53.990027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2993b-c6b5-4045-8832-ae2a90afca8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:53.991473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2993b-c6b5-4045-8832-ae2a90afca8f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:54.018246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 521/1049] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:16:53 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:16:54.093780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f5a03-543f-46b5-8491-36cded4ac182 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:54.131336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:54.132037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:54.132318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:54.132585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:54.145161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:54.146663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:54.162578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:54.163615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:54.169234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:54.169234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:54.169234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:54.169234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 529/1050] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:54.169499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2993b-c6b5-4045-8832-ae2a90afca8f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:54.238660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:54.275653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2993b-c6b5-4045-8832-ae2a90afca8f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:54.310202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:54.310803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:54.311143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:54.311350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:54.311973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:54.312274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:54.313626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:54.325591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 522/1051] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:54.331464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:54.366463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:54.432054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed2192-660f-432c-a1e3-a5911b840d32 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:54.465888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:54.466542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:54.466818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:54.467085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:54.474444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:54.475923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:54.487254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:54.488231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:54.489176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:54.493076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 530/1052] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:16:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:54.494087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:54.595509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac18d7-7d00-41ab-a09f-545855d9e6e6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:54.622583 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:54.632141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:54.632740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:54.633017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:54.633287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:54.634004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:54.634336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:54.635755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:54.654211 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 523/1053] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:16:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:54.659238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:54.755078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:54.762364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107cec5-4491-462b-a36c-8a1e27a8277b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:54.796803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:54.797422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:54.797696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:54.797961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:54.808504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:54.810009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:54.823621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:54.824529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:54.825416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:54.825416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:54.825416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:54.825416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 531/1054] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:54.832042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:54.940340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3705fc-d1ea-4dc2-b697-4ce394f17e23 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:54.976440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5069856-a580-4664-8e4e-f49db3e23e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:54.977038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069856-a580-4664-8e4e-f49db3e23e17 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:54.977317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069856-a580-4664-8e4e-f49db3e23e17 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:54.977588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069856-a580-4664-8e4e-f49db3e23e17 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:54.978239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069856-a580-4664-8e4e-f49db3e23e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:54.978540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069856-a580-4664-8e4e-f49db3e23e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:54.979890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069856-a580-4664-8e4e-f49db3e23e17 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:54.991062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 524/1055] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:54.996422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:55.022555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa532-0fcf-48b6-83db-42dd84ab65dd None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.022850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa532-0fcf-48b6-83db-42dd84ab65dd None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.023129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa532-0fcf-48b6-83db-42dd84ab65dd None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.024644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 525/1056] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:55.029364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f93d-1ba0-4bf3-a4f8-7b2a6d0a1e50 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.029648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f93d-1ba0-4bf3-a4f8-7b2a6d0a1e50 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.029922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f93d-1ba0-4bf3-a4f8-7b2a6d0a1e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.049599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3765f93d-1ba0-4bf3-a4f8-7b2a6d0a1e50 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:55.050842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3765f93d-1ba0-4bf3-a4f8-7b2a6d0a1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:55.094167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:55.108787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7ca16-b8d6-424e-8bd3-40d8afa34419 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:55.123944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 526/1057] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:55.146685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:55.146956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765f93d-1ba0-4bf3-a4f8-7b2a6d0a1e50 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:55.147448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.147793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.148126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.157400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:55.159524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:55.171069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:55.171983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:55.172915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 532/1058] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:55.177710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:55.187545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:55.254329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765f93d-1ba0-4bf3-a4f8-7b2a6d0a1e50 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:55.287533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a446c-2d4f-437f-8df4-bd5e945a0309 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:55.289945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:55.290680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.291032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.291377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] PATH_INFO: `/v3/services/image` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.292029 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:55.293465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:55.302289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:55.303448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 00:16:55.304466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:55.305690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 527/1059] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Aug 8 00:16:55 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:55.311188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:55.326394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:55.327121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.327947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.328227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.328910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:55.329218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:55.330671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:55.349413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 533/1060] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:55.350480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:55.359617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:55.422193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:55.427734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26201156-c70a-4ddf-a57c-e811c2fd60ee None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:55.458202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cc7a2-23d2-4a45-a7dd-2618134c3c52 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:55.464875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:55.466156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.466606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.467026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.468753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:55.469205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:55.471389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:55.478263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 528/1061] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:55.484610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:55.494101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c42bcf-446c-4a45-96d1-feda84ac0375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:55.494767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42bcf-446c-4a45-96d1-feda84ac0375 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.495044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42bcf-446c-4a45-96d1-feda84ac0375 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.495312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42bcf-446c-4a45-96d1-feda84ac0375 None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/fe6573439abd4afb8098390eb4c7e5ef/roles/6500b899a635405583e8c8861c569559` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.497464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c42bcf-446c-4a45-96d1-feda84ac0375 None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=fe6573439abd4afb8098390eb4c7e5ef, role_id=6500b899a635405583e8c8861c569559)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:55.498982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c42bcf-446c-4a45-96d1-feda84ac0375 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:55.514210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 534/1062] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:16:55 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/fe6573439abd4afb8098390eb4c7e5ef/roles/6500b899a635405583e8c8861c569559 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:16:55.603891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb18793-9e18-4a4f-8494-b4c3fb4eeee7 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:55.606314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:55.644776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92babc-186a-4cb4-aa44-834f727e6722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:55.645400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92babc-186a-4cb4-aa44-834f727e6722 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.645679 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92babc-186a-4cb4-aa44-834f727e6722 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.645951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92babc-186a-4cb4-aa44-834f727e6722 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.646859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92babc-186a-4cb4-aa44-834f727e6722 None admin] RBAC: Adding query filter params (type=image) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:55.647168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92babc-186a-4cb4-aa44-834f727e6722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:55.648561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92babc-186a-4cb4-aa44-834f727e6722 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:55.659584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 529/1063] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:55.661176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c42bcf-446c-4a45-96d1-feda84ac0375 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:55.767184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c42bcf-446c-4a45-96d1-feda84ac0375 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:55.793479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:55.803465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b830a-dd5d-4249-b9b3-013241de34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:55.804076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b830a-dd5d-4249-b9b3-013241de34dd None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:55.804354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b830a-dd5d-4249-b9b3-013241de34dd None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:55.804622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b830a-dd5d-4249-b9b3-013241de34dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:55.805276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b830a-dd5d-4249-b9b3-013241de34dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:55.806671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b830a-dd5d-4249-b9b3-013241de34dd None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:55.834094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 535/1064] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:16:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:16:56.097163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdddc5a-bf12-4c29-933a-08d2444fbf76 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:56.097358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdddc5a-bf12-4c29-933a-08d2444fbf76 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:56.097631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdddc5a-bf12-4c29-933a-08d2444fbf76 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:56.099153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 530/1065] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:56.104112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dfd4c-1022-4c21-8e6f-e6fc47b38ed7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:56.104403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dfd4c-1022-4c21-8e6f-e6fc47b38ed7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:56.104682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dfd4c-1022-4c21-8e6f-e6fc47b38ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:56.123095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4e3dfd4c-1022-4c21-8e6f-e6fc47b38ed7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:56.124795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4e3dfd4c-1022-4c21-8e6f-e6fc47b38ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:56.199047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 536/1066] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:56.222296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdddc5a-bf12-4c29-933a-08d2444fbf76 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:56.325780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdddc5a-bf12-4c29-933a-08d2444fbf76 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:56.360775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313706e3-94b6-4426-bc44-9779dddc8ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:56.361797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313706e3-94b6-4426-bc44-9779dddc8ddb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:56.362302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313706e3-94b6-4426-bc44-9779dddc8ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:56.362808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313706e3-94b6-4426-bc44-9779dddc8ddb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:56.373285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313706e3-94b6-4426-bc44-9779dddc8ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-313706e3-94b6-4426-bc44-9779dddc8ddb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:56.378813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:56.379783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:56.380629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:56.382693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 531/1067] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:56.388501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dfd4c-1022-4c21-8e6f-e6fc47b38ed7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:56.489856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dfd4c-1022-4c21-8e6f-e6fc47b38ed7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:56.500171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:56.526827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:56.527680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:56.528144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:56.528598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:56.529457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:56.529941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:56.531627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:56.539958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 537/1068] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:56.545750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313706e3-94b6-4426-bc44-9779dddc8ddb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:56.575104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:56.652269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313706e3-94b6-4426-bc44-9779dddc8ddb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:56.686509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcc289-406e-4e8e-8b93-43b7a0c77915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:56.687125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcc289-406e-4e8e-8b93-43b7a0c77915 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:56.687402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcc289-406e-4e8e-8b93-43b7a0c77915 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:56.687670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcc289-406e-4e8e-8b93-43b7a0c77915 None admin] PATH_INFO: `/v3/users/64bb469245ab42819cbd1f0de7f172bf` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:56.700506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcc289-406e-4e8e-8b93-43b7a0c77915 None admin] RBAC: Authorizing `identity:get_user(user_id=64bb469245ab42819cbd1f0de7f172bf)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:56.701946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcc289-406e-4e8e-8b93-43b7a0c77915 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:56.708544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 532/1069] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:16:56 2022] GET /identity/v3/users/64bb469245ab42819cbd1f0de7f172bf => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:56.709492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:56.808350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0accc-f2d1-4510-b0cb-27653d9960f0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:56.840833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d2b87-60fd-48d0-88d1-032de3abcaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:56.841429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2b87-60fd-48d0-88d1-032de3abcaec None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:56.841705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2b87-60fd-48d0-88d1-032de3abcaec None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:56.841973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2b87-60fd-48d0-88d1-032de3abcaec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:56.888887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:56.919961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d2b87-60fd-48d0-88d1-032de3abcaec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:56.921908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d2b87-60fd-48d0-88d1-032de3abcaec None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:57.026662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 538/1070] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 00:16:57.028181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcc289-406e-4e8e-8b93-43b7a0c77915 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:57.111809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:57.128927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcc289-406e-4e8e-8b93-43b7a0c77915 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:57.163383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2a598-4113-47c7-9905-2b73b93d93f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:57.164001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a598-4113-47c7-9905-2b73b93d93f3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:57.164278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a598-4113-47c7-9905-2b73b93d93f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:57.164545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a598-4113-47c7-9905-2b73b93d93f3 None admin] PATH_INFO: `/v3/projects/1e304b36c9df4aaf9384376c64c33563` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:57.165643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2a598-4113-47c7-9905-2b73b93d93f3 None admin] RBAC: Authorizing `identity:get_project(project_id=1e304b36c9df4aaf9384376c64c33563)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:57.167099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2a598-4113-47c7-9905-2b73b93d93f3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:57.173944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 533/1071] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:16:57 2022] GET /identity/v3/projects/1e304b36c9df4aaf9384376c64c33563 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:57.174871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d2b87-60fd-48d0-88d1-032de3abcaec None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:57.244582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:57.278704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d2b87-60fd-48d0-88d1-032de3abcaec None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:57.312399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc05de4-3228-4ed6-bc1e-a76844937352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:57.312999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc05de4-3228-4ed6-bc1e-a76844937352 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:57.313276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc05de4-3228-4ed6-bc1e-a76844937352 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:57.313546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc05de4-3228-4ed6-bc1e-a76844937352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:57.314283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc05de4-3228-4ed6-bc1e-a76844937352 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=1e304b36c9df4aaf9384376c64c33563, user.id=64bb469245ab42819cbd1f0de7f172bf) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:57.314592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc05de4-3228-4ed6-bc1e-a76844937352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:57.316067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc05de4-3228-4ed6-bc1e-a76844937352 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:57.330364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 539/1072] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:57 2022] GET /identity/v3/role_assignments?user.id=64bb469245ab42819cbd1f0de7f172bf&scope.project.id=1e304b36c9df4aaf9384376c64c33563&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:57.538632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b77b-1270-4854-8f77-42811ac2bc69 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:57.539027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b77b-1270-4854-8f77-42811ac2bc69 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:57.539223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b77b-1270-4854-8f77-42811ac2bc69 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:57.540662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 534/1073] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:57.545745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c372-f9c9-4c29-ab0a-55c988f19bc2 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:57.546044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c372-f9c9-4c29-ab0a-55c988f19bc2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:57.546417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c372-f9c9-4c29-ab0a-55c988f19bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:57.565133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a835c372-f9c9-4c29-ab0a-55c988f19bc2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:57.566366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a835c372-f9c9-4c29-ab0a-55c988f19bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:57.638152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 540/1074] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:16:57.661861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b77b-1270-4854-8f77-42811ac2bc69 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:57.767002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b77b-1270-4854-8f77-42811ac2bc69 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:57.801589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6423f-ab66-46df-bc8b-6e73557566be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:57.802165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6423f-ab66-46df-bc8b-6e73557566be None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:57.802449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6423f-ab66-46df-bc8b-6e73557566be None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:57.802720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6423f-ab66-46df-bc8b-6e73557566be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:57.812919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6423f-ab66-46df-bc8b-6e73557566be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-dfa6423f-ab66-46df-bc8b-6e73557566be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:57.817530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:57.818729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 00:16:57.819561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:57.822420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 535/1075] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Aug 8 00:16:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:57.824785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c372-f9c9-4c29-ab0a-55c988f19bc2 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:57.896861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb6bc-ef27-4501-9117-d19887726fb3 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:57.897149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb6bc-ef27-4501-9117-d19887726fb3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:57.897429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb6bc-ef27-4501-9117-d19887726fb3 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:57.898942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 536/1076] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:16:57.900118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:57.903639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3721a22-3655-4659-a84f-218a44c11cfa None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:57.903929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3721a22-3655-4659-a84f-218a44c11cfa None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:57.904254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3721a22-3655-4659-a84f-218a44c11cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:57.923119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c3721a22-3655-4659-a84f-218a44c11cfa None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:57.924299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c3721a22-3655-4659-a84f-218a44c11cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:57.931901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:57.940184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c372-f9c9-4c29-ab0a-55c988f19bc2 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:57.974541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:57.975201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:57.975433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:57.975707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:57.976367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:57.976668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:57.978025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:57.986400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 541/1077] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 00:16:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:57.991963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:58.006655 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 537/1078] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:58.029135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3721a22-3655-4659-a84f-218a44c11cfa None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:58.104212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f60d1-aff1-4b4c-9116-4cc480a60de0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:58.135019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:58.135324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3721a22-3655-4659-a84f-218a44c11cfa None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:58.146852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:58.147821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:58.148249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:58.148529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:58.159831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:58.161247 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:58.173405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49095ac-9c96-44a8-a3c7-3068632d7cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:58.174005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49095ac-9c96-44a8-a3c7-3068632d7cf0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:58.174318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49095ac-9c96-44a8-a3c7-3068632d7cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:58.174591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49095ac-9c96-44a8-a3c7-3068632d7cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:58.174903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:58.175793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:58.176692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:58.176692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:58.176692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:58.176692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 542/1079] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:58.181569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:58.191310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:58.252724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49095ac-9c96-44a8-a3c7-3068632d7cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:58.254253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49095ac-9c96-44a8-a3c7-3068632d7cf0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:58.286555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485fd13-5443-4715-a4cc-019aa21d5d33 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:58.320937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:58.321566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:58.321869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:58.322187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:58.322862 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:58.323187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:58.324542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:58.336676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 543/1080] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:58.342239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:58.369052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 538/1081] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 00:16:58.370322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49095ac-9c96-44a8-a3c7-3068632d7cf0 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:58.384316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:58.418355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:58.452882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d6c54-3886-487b-841b-5911ffb513db None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:58.481068 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49095ac-9c96-44a8-a3c7-3068632d7cf0 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:58.488338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:58.489362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:58.489664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:58.489936 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] PATH_INFO: `/v3/users/nova` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:58.498552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:58.500700 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:16:58.512234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:58.513140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:58.514719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 544/1082] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Aug 8 00:16:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:58.519206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:58.520194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:58.520840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:58.521121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:58.521392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:58.531675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:58.533110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:58.548083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:58.549022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:58.550095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:58.550095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:58.550095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:58.550095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 539/1083] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:58.555002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:58.621035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:58.627980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b809b9-9c9a-4581-a0d1-d1aff6d6bafb None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:58.651042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:58.658504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14b02-3e65-4b7f-a03e-5e7ef26d90c9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:58.663228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:58.663830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:58.664111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:58.664382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:58.665151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:58.665533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:58.666976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:58.685656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 545/1084] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Aug 8 00:16:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:58.691716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:58.696263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:58.696873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:58.697153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:58.697426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:58.698095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:58.698425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:58.700233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:58.712687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 540/1085] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:58.801550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea19c0-a3d7-47d6-bc97-4367276d1d4f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:58.837793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecac990-018a-46c7-9cfe-b503d8afe283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:58.838513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac990-018a-46c7-9cfe-b503d8afe283 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:58.838754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac990-018a-46c7-9cfe-b503d8afe283 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:58.838969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac990-018a-46c7-9cfe-b503d8afe283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:58.873091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:58.920243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecac990-018a-46c7-9cfe-b503d8afe283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:58.922685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecac990-018a-46c7-9cfe-b503d8afe283 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:59.029431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 546/1086] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:16:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 00:16:59.035660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.132636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72283555-a166-4d6b-9927-f35ea42825d5 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:59.167213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1716c5-5750-4848-8825-5ac56bbaf23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:59.167837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1716c5-5750-4848-8825-5ac56bbaf23b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.168116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1716c5-5750-4848-8825-5ac56bbaf23b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.168387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1716c5-5750-4848-8825-5ac56bbaf23b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.178694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1716c5-5750-4848-8825-5ac56bbaf23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:59.180128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1716c5-5750-4848-8825-5ac56bbaf23b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-7f1716c5-5750-4848-8825-5ac56bbaf23b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:16:59.194078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:59.195196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:16:59.196283 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:16:59.196283 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:16:59.196283 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:59.198223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 541/1087] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:59.200778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecac990-018a-46c7-9cfe-b503d8afe283 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.255533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:59.287814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff84b-02f5-4d7e-8110-3564281f88b5 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.288096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff84b-02f5-4d7e-8110-3564281f88b5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.288372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff84b-02f5-4d7e-8110-3564281f88b5 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.289701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 542/1088] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:16:59.294343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dbc51-7384-4985-9bad-32796f7c6072 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.294625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dbc51-7384-4985-9bad-32796f7c6072 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.294898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dbc51-7384-4985-9bad-32796f7c6072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.299724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecac990-018a-46c7-9cfe-b503d8afe283 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:59.307416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:59.313043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8a3dbc51-7384-4985-9bad-32796f7c6072 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:16:59.314259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8a3dbc51-7384-4985-9bad-32796f7c6072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:16:59.333715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:59.334341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.334623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.334899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.335524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:59.335823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:59.337171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:59.353125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 547/1089] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:59.354275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.385177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 543/1090] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:16:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:16:59.408752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dbc51-7384-4985-9bad-32796f7c6072 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.451118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d22c-78b1-4648-be7f-24dc2c32127a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:59.466919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:59.484993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:59.485607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.485884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.486208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.492726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:59.494191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:16:59.505640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:59.506732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:59.507672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:16:59.507672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:16:59.507672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:16:59.507672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:16:59.507672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:16:59.507672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:16:59.507672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:16:59.507672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:16:59.508118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dbc51-7384-4985-9bad-32796f7c6072 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:59.508200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 548/1091] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:16:59.512427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.541394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb0a4b-0246-442f-8f5d-ebc9ff859a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:59.542007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb0a4b-0246-442f-8f5d-ebc9ff859a65 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.542309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb0a4b-0246-442f-8f5d-ebc9ff859a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.542576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb0a4b-0246-442f-8f5d-ebc9ff859a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.545123 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:59.553223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb0a4b-0246-442f-8f5d-ebc9ff859a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-58fb0a4b-0246-442f-8f5d-ebc9ff859a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:16:59.557790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:16:59.558945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:16:59.560012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 544/1092] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:16:59.564889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb0a4b-0246-442f-8f5d-ebc9ff859a65 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.614708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7dd3b-595e-4b89-82b7-2346503e09dd None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:59.649837 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:59.650386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.650660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.650929 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.651602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:59.651903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:59.653309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:59.670088 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 549/1093] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:59.671130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.673354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb0a4b-0246-442f-8f5d-ebc9ff859a65 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:59.707448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:59.709051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:59.709736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.709931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.710275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.710966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:59.711267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:59.713051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:59.721628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 545/1094] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:59.727361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.773403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabea444-b975-474c-a7b8-165fd97168c1 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:59.782821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:59.808613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:59.809228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.809507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.809774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.810522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] RBAC: Adding query filter params (role.id=6500b899a635405583e8c8861c569559, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=fe6573439abd4afb8098390eb4c7e5ef) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:16:59.810827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:59.812731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:59.818411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 550/1095] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/role_assignments?user.id=fe6573439abd4afb8098390eb4c7e5ef&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=6500b899a635405583e8c8861c569559 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:16:59.824554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1da23-ff79-4cd9-8515-627feaecf35f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:16:59.866008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51181573-bdff-4335-89b1-b023229ecbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:16:59.866711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181573-bdff-4335-89b1-b023229ecbf6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:16:59.866991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181573-bdff-4335-89b1-b023229ecbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:16:59.867264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181573-bdff-4335-89b1-b023229ecbf6 None admin] PATH_INFO: `/v3/users/64bb469245ab42819cbd1f0de7f172bf` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:16:59.868479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51181573-bdff-4335-89b1-b023229ecbf6 None admin] RBAC: Authorizing `identity:get_user(user_id=64bb469245ab42819cbd1f0de7f172bf)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:16:59.869956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51181573-bdff-4335-89b1-b023229ecbf6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:16:59.871670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 546/1096] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/users/64bb469245ab42819cbd1f0de7f172bf => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:16:59.878417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:16:59.981991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:16:59.985556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ea55f-5a2d-42bd-95c5-28df97fe5d3c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:00.020972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8410a6-2459-4d69-8851-b3b10e1b91d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:00.021596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8410a6-2459-4d69-8851-b3b10e1b91d6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:00.021874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8410a6-2459-4d69-8851-b3b10e1b91d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:00.022173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8410a6-2459-4d69-8851-b3b10e1b91d6 None admin] PATH_INFO: `/v3/projects/1e304b36c9df4aaf9384376c64c33563` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:00.023290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8410a6-2459-4d69-8851-b3b10e1b91d6 None admin] RBAC: Authorizing `identity:get_project(project_id=1e304b36c9df4aaf9384376c64c33563)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:00.024702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8410a6-2459-4d69-8851-b3b10e1b91d6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:00.026378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 551/1097] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:16:59 2022] GET /identity/v3/projects/1e304b36c9df4aaf9384376c64c33563 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:00.032506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51181573-bdff-4335-89b1-b023229ecbf6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:00.136521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51181573-bdff-4335-89b1-b023229ecbf6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:00.161904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:00.171449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85da43-af3c-4112-ab51-9dcb6395fa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:00.172096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85da43-af3c-4112-ab51-9dcb6395fa59 None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:00.172377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85da43-af3c-4112-ab51-9dcb6395fa59 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:00.172642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85da43-af3c-4112-ab51-9dcb6395fa59 None admin] PATH_INFO: `/v3/projects/1e304b36c9df4aaf9384376c64c33563/users/64bb469245ab42819cbd1f0de7f172bf/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:00.174579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85da43-af3c-4112-ab51-9dcb6395fa59 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e304b36c9df4aaf9384376c64c33563, user_id=64bb469245ab42819cbd1f0de7f172bf, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:00.176008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85da43-af3c-4112-ab51-9dcb6395fa59 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:00.190279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 547/1098] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:17:00 2022] PUT /identity/v3/projects/1e304b36c9df4aaf9384376c64c33563/users/64bb469245ab42819cbd1f0de7f172bf/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:17:02.213293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179612e-8feb-493e-af54-eb9ab0361dac None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:02.213783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179612e-8feb-493e-af54-eb9ab0361dac None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:02.213783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179612e-8feb-493e-af54-eb9ab0361dac None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:02.215132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 552/1099] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:02.220897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbdc8-e87b-4fac-80e8-b38470670376 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:02.221267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbdc8-e87b-4fac-80e8-b38470670376 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:02.221450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbdc8-e87b-4fac-80e8-b38470670376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:02.239588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-5a5fbdc8-e87b-4fac-80e8-b38470670376 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:02.240704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5a5fbdc8-e87b-4fac-80e8-b38470670376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:02.305053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 548/1100] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:02.327610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179612e-8feb-493e-af54-eb9ab0361dac None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:02.426764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179612e-8feb-493e-af54-eb9ab0361dac None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:02.459005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f1e3-e4e7-43bc-8595-60b5df01081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:02.459609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f1e3-e4e7-43bc-8595-60b5df01081f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:02.459886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f1e3-e4e7-43bc-8595-60b5df01081f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:02.460158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f1e3-e4e7-43bc-8595-60b5df01081f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:02.470537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231f1e3-e4e7-43bc-8595-60b5df01081f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-b231f1e3-e4e7-43bc-8595-60b5df01081f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:17:02.475130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:17:02.476021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:17:02.476902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 553/1101] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:17:02.483532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fbdc8-e87b-4fac-80e8-b38470670376 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:02.579808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fbdc8-e87b-4fac-80e8-b38470670376 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:02.595868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:02.614027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:02.614641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:02.614918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:02.615190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:02.615840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:02.616140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:02.617492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:02.625667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 549/1102] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:02.631331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f1e3-e4e7-43bc-8595-60b5df01081f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:02.659781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:02.729111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f1e3-e4e7-43bc-8595-60b5df01081f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:02.762535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346dd3f-2648-406f-b15c-c13e5b83bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:02.763147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346dd3f-2648-406f-b15c-c13e5b83bb6b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:02.763424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346dd3f-2648-406f-b15c-c13e5b83bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:02.763696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346dd3f-2648-406f-b15c-c13e5b83bb6b None admin] PATH_INFO: `/v3/users/64bb469245ab42819cbd1f0de7f172bf` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:02.765396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346dd3f-2648-406f-b15c-c13e5b83bb6b None admin] RBAC: Authorizing `identity:get_user(user_id=64bb469245ab42819cbd1f0de7f172bf)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:02.766834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346dd3f-2648-406f-b15c-c13e5b83bb6b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:02.768661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 554/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:02 2022] GET /identity/v3/users/64bb469245ab42819cbd1f0de7f172bf => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:02.774365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:02.870720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bdbd-3f31-4791-a59f-e189612a34b2 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:02.904404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79565071-9225-4e79-be77-7a5ca7e47b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:02.904996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565071-9225-4e79-be77-7a5ca7e47b25 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:02.905274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565071-9225-4e79-be77-7a5ca7e47b25 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:02.905545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565071-9225-4e79-be77-7a5ca7e47b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:02.948972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:02.970451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79565071-9225-4e79-be77-7a5ca7e47b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:02.971887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79565071-9225-4e79-be77-7a5ca7e47b25 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:03.067278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 550/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:17:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:17:03.073090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346dd3f-2648-406f-b15c-c13e5b83bb6b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:03.164030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:03.170220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346dd3f-2648-406f-b15c-c13e5b83bb6b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:03.203541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965e194-f0a1-4629-a959-61ab2ff79066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:03.204158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e194-f0a1-4629-a959-61ab2ff79066 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:03.204439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e194-f0a1-4629-a959-61ab2ff79066 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:03.204713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e194-f0a1-4629-a959-61ab2ff79066 None admin] PATH_INFO: `/v3/projects/1e304b36c9df4aaf9384376c64c33563` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:03.205825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965e194-f0a1-4629-a959-61ab2ff79066 None admin] RBAC: Authorizing `identity:get_project(project_id=1e304b36c9df4aaf9384376c64c33563)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:03.207284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965e194-f0a1-4629-a959-61ab2ff79066 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:03.208893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 555/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:03 2022] GET /identity/v3/projects/1e304b36c9df4aaf9384376c64c33563 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:03.214954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79565071-9225-4e79-be77-7a5ca7e47b25 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:03.289226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:03.310238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79565071-9225-4e79-be77-7a5ca7e47b25 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:03.342972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9af62a-355f-4813-b047-ba0f71c06073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:03.343500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9af62a-355f-4813-b047-ba0f71c06073 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:03.343780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9af62a-355f-4813-b047-ba0f71c06073 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:03.344054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9af62a-355f-4813-b047-ba0f71c06073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:03.344764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9af62a-355f-4813-b047-ba0f71c06073 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=1e304b36c9df4aaf9384376c64c33563, user.id=64bb469245ab42819cbd1f0de7f172bf) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:03.345074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9af62a-355f-4813-b047-ba0f71c06073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:03.346522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9af62a-355f-4813-b047-ba0f71c06073 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:03.352047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 551/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:17:03 2022] GET /identity/v3/role_assignments?user.id=64bb469245ab42819cbd1f0de7f172bf&scope.project.id=1e304b36c9df4aaf9384376c64c33563&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:05.329606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513ba9-f468-4abf-a59a-6ab288387491 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:05.330167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513ba9-f468-4abf-a59a-6ab288387491 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:05.330261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513ba9-f468-4abf-a59a-6ab288387491 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:05.331549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 556/1107] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:05.336718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6888-561e-4ae0-89ce-b3fe310f32a0 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:05.337091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6888-561e-4ae0-89ce-b3fe310f32a0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:05.337265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6888-561e-4ae0-89ce-b3fe310f32a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:05.355988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-df7f6888-561e-4ae0-89ce-b3fe310f32a0 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:05.357162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-df7f6888-561e-4ae0-89ce-b3fe310f32a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:05.421955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 552/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:05.445785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513ba9-f468-4abf-a59a-6ab288387491 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:05.546182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513ba9-f468-4abf-a59a-6ab288387491 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:05.578959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37006f3f-b87a-4eef-8adf-922b2547eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:05.579598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37006f3f-b87a-4eef-8adf-922b2547eedf None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:05.579923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37006f3f-b87a-4eef-8adf-922b2547eedf None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:05.580147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37006f3f-b87a-4eef-8adf-922b2547eedf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:05.581238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37006f3f-b87a-4eef-8adf-922b2547eedf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:05.582683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37006f3f-b87a-4eef-8adf-922b2547eedf None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:05.584218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 557/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:17:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:05.589839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6888-561e-4ae0-89ce-b3fe310f32a0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:05.662000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:05.690989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6888-561e-4ae0-89ce-b3fe310f32a0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:05.723687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111bb89-bf26-4cda-8db2-d9e4fd5ee1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:05.724276 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bb89-bf26-4cda-8db2-d9e4fd5ee1a2 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:05.724556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bb89-bf26-4cda-8db2-d9e4fd5ee1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:05.724828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bb89-bf26-4cda-8db2-d9e4fd5ee1a2 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:05.725473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111bb89-bf26-4cda-8db2-d9e4fd5ee1a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:05.726929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111bb89-bf26-4cda-8db2-d9e4fd5ee1a2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:05.746706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 553/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:17:05 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:17:07.749640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502f253-59ab-47c0-ba34-e9192ba99034 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:07.750192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502f253-59ab-47c0-ba34-e9192ba99034 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:07.750192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502f253-59ab-47c0-ba34-e9192ba99034 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:07.751543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 558/1111] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:07.756554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61751ef5-1bf6-4979-9f99-24a3c8b2517f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:07.756972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61751ef5-1bf6-4979-9f99-24a3c8b2517f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:07.757100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61751ef5-1bf6-4979-9f99-24a3c8b2517f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:07.774772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-61751ef5-1bf6-4979-9f99-24a3c8b2517f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:07.775947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-61751ef5-1bf6-4979-9f99-24a3c8b2517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:07.846541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 554/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:17:07.870024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502f253-59ab-47c0-ba34-e9192ba99034 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:07.901430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:07.972275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502f253-59ab-47c0-ba34-e9192ba99034 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:08.004924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aef3a-4f55-4bcb-b4d9-bf91c7e1f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:08.005476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aef3a-4f55-4bcb-b4d9-bf91c7e1f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:08.005755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aef3a-4f55-4bcb-b4d9-bf91c7e1f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:08.006032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aef3a-4f55-4bcb-b4d9-bf91c7e1f6f0 None admin] PATH_INFO: `/v3/roles/45f0e969ef594665877c4596781ce6aa` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:08.007429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aef3a-4f55-4bcb-b4d9-bf91c7e1f6f0 None admin] RBAC: Authorizing `identity:get_role(role_id=45f0e969ef594665877c4596781ce6aa)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:08.008779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aef3a-4f55-4bcb-b4d9-bf91c7e1f6f0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:08.010090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 559/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:07 2022] GET /identity/v3/roles/45f0e969ef594665877c4596781ce6aa => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:08.016046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61751ef5-1bf6-4979-9f99-24a3c8b2517f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:08.072085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:08.112706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61751ef5-1bf6-4979-9f99-24a3c8b2517f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:08.144933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb7ad5-3906-4de8-88d5-cde1b9458b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:08.145548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb7ad5-3906-4de8-88d5-cde1b9458b2e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:08.145828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb7ad5-3906-4de8-88d5-cde1b9458b2e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:08.146123 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb7ad5-3906-4de8-88d5-cde1b9458b2e None admin] PATH_INFO: `/v3/users/f3f8c7c2bb884e919049324566717a63` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:08.161025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb7ad5-3906-4de8-88d5-cde1b9458b2e None admin] RBAC: Authorizing `identity:get_user(user_id=f3f8c7c2bb884e919049324566717a63)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:08.162516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb7ad5-3906-4de8-88d5-cde1b9458b2e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:08.164195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 555/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:08 2022] GET /identity/v3/users/f3f8c7c2bb884e919049324566717a63 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:08.170007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aef3a-4f55-4bcb-b4d9-bf91c7e1f6f0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:08.263813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:08.267006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aef3a-4f55-4bcb-b4d9-bf91c7e1f6f0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:08.300631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8226-de41-478c-8695-c49c0e5dfe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:08.301225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8226-de41-478c-8695-c49c0e5dfe75 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:08.301505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8226-de41-478c-8695-c49c0e5dfe75 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:08.301775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8226-de41-478c-8695-c49c0e5dfe75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:08.365758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8226-de41-478c-8695-c49c0e5dfe75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:08.367214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8226-de41-478c-8695-c49c0e5dfe75 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:08.458242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:08.461666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 560/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:17:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:17:08.468142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb7ad5-3906-4de8-88d5-cde1b9458b2e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:08.567354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb7ad5-3906-4de8-88d5-cde1b9458b2e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:08.583386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:08.601426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b1128-8122-48dd-ab32-2fa98c68e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:08.602042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b1128-8122-48dd-ab32-2fa98c68e06b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:08.602526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b1128-8122-48dd-ab32-2fa98c68e06b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:08.602799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b1128-8122-48dd-ab32-2fa98c68e06b None admin] PATH_INFO: `/v3/projects/1e304b36c9df4aaf9384376c64c33563` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:08.603900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b1128-8122-48dd-ab32-2fa98c68e06b None admin] RBAC: Authorizing `identity:get_project(project_id=1e304b36c9df4aaf9384376c64c33563)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:08.605322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b1128-8122-48dd-ab32-2fa98c68e06b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:08.606969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 556/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:08 2022] GET /identity/v3/projects/1e304b36c9df4aaf9384376c64c33563 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:08.613061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8226-de41-478c-8695-c49c0e5dfe75 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:08.708614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8226-de41-478c-8695-c49c0e5dfe75 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:08.741027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51361de-3350-44d9-8521-9e33a301a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:08.741616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51361de-3350-44d9-8521-9e33a301a42d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:08.741900 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51361de-3350-44d9-8521-9e33a301a42d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:08.742205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51361de-3350-44d9-8521-9e33a301a42d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:08.742913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51361de-3350-44d9-8521-9e33a301a42d None admin] RBAC: Adding query filter params (role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=1e304b36c9df4aaf9384376c64c33563, user.id=f3f8c7c2bb884e919049324566717a63) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:08.743221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51361de-3350-44d9-8521-9e33a301a42d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:08.744620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51361de-3350-44d9-8521-9e33a301a42d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:08.750284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 561/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:17:08 2022] GET /identity/v3/role_assignments?user.id=f3f8c7c2bb884e919049324566717a63&scope.project.id=1e304b36c9df4aaf9384376c64c33563&role.id=45f0e969ef594665877c4596781ce6aa => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:10.673885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9697-ca55-48a1-9286-212fc21e06fc None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:10.674466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9697-ca55-48a1-9286-212fc21e06fc None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:10.674466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9697-ca55-48a1-9286-212fc21e06fc None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:10.675808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 557/1118] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:10.680953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5707-f9bd-41dd-a883-bf77a0fe0430 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:10.681352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5707-f9bd-41dd-a883-bf77a0fe0430 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:10.681496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5707-f9bd-41dd-a883-bf77a0fe0430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:10.699716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f0ff5707-f9bd-41dd-a883-bf77a0fe0430 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:10.700916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f0ff5707-f9bd-41dd-a883-bf77a0fe0430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:10.757675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:10.765901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 562/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:10.787860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce9697-ca55-48a1-9286-212fc21e06fc None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:10.888729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce9697-ca55-48a1-9286-212fc21e06fc None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:10.922543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621786-7701-43ca-816b-0e71e1afc1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:10.923152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621786-7701-43ca-816b-0e71e1afc1f8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:10.923434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621786-7701-43ca-816b-0e71e1afc1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:10.923709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621786-7701-43ca-816b-0e71e1afc1f8 None admin] PATH_INFO: `/v3/roles/45f0e969ef594665877c4596781ce6aa` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:10.925135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09621786-7701-43ca-816b-0e71e1afc1f8 None admin] RBAC: Authorizing `identity:get_role(role_id=45f0e969ef594665877c4596781ce6aa)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:10.926491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09621786-7701-43ca-816b-0e71e1afc1f8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:10.927797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 558/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:10 2022] GET /identity/v3/roles/45f0e969ef594665877c4596781ce6aa => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:10.933466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff5707-f9bd-41dd-a883-bf77a0fe0430 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:11.027881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff5707-f9bd-41dd-a883-bf77a0fe0430 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:11.061120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c708ce-849e-4144-a086-e3f351dae450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:11.061739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c708ce-849e-4144-a086-e3f351dae450 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:11.062020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c708ce-849e-4144-a086-e3f351dae450 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:11.062328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c708ce-849e-4144-a086-e3f351dae450 None admin] PATH_INFO: `/v3/users/f3f8c7c2bb884e919049324566717a63` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:11.063432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c708ce-849e-4144-a086-e3f351dae450 None admin] RBAC: Authorizing `identity:get_user(user_id=f3f8c7c2bb884e919049324566717a63)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:11.064855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c708ce-849e-4144-a086-e3f351dae450 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:11.066455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 563/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:10 2022] GET /identity/v3/users/f3f8c7c2bb884e919049324566717a63 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:11.072121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621786-7701-43ca-816b-0e71e1afc1f8 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:11.123297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:11.168879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621786-7701-43ca-816b-0e71e1afc1f8 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:11.200804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934b273-1604-4c66-9cee-ab4d0e8b7c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:11.201382 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b273-1604-4c66-9cee-ab4d0e8b7c41 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:11.201658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b273-1604-4c66-9cee-ab4d0e8b7c41 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:11.201922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b273-1604-4c66-9cee-ab4d0e8b7c41 None admin] PATH_INFO: `/v3/projects/1e304b36c9df4aaf9384376c64c33563` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:11.203039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934b273-1604-4c66-9cee-ab4d0e8b7c41 None admin] RBAC: Authorizing `identity:get_project(project_id=1e304b36c9df4aaf9384376c64c33563)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:11.204446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934b273-1604-4c66-9cee-ab4d0e8b7c41 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:11.206075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 559/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:11 2022] GET /identity/v3/projects/1e304b36c9df4aaf9384376c64c33563 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:17:11.212121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c708ce-849e-4144-a086-e3f351dae450 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:11.271769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:11.309076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c708ce-849e-4144-a086-e3f351dae450 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:11.341872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be2e12-14b7-4229-8195-560160f39070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:11.343078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2e12-14b7-4229-8195-560160f39070 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:11.343351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2e12-14b7-4229-8195-560160f39070 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:11.343617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2e12-14b7-4229-8195-560160f39070 None admin] PATH_INFO: `/v3/projects/1e304b36c9df4aaf9384376c64c33563/users/f3f8c7c2bb884e919049324566717a63/roles/45f0e969ef594665877c4596781ce6aa` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:11.345711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2e12-14b7-4229-8195-560160f39070 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e304b36c9df4aaf9384376c64c33563, user_id=f3f8c7c2bb884e919049324566717a63, role_id=45f0e969ef594665877c4596781ce6aa)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:11.347145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2e12-14b7-4229-8195-560160f39070 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:11.359741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 564/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:17:11 2022] PUT /identity/v3/projects/1e304b36c9df4aaf9384376c64c33563/users/f3f8c7c2bb884e919049324566717a63/roles/45f0e969ef594665877c4596781ce6aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:17:13.301676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d851571-cec3-4537-a291-21437b247fdc None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:13.302263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d851571-cec3-4537-a291-21437b247fdc None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:13.302263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d851571-cec3-4537-a291-21437b247fdc None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:13.303603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 560/1124] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:13.308578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab085a-59f1-4dea-81ec-8ba887f9a678 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:13.309000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab085a-59f1-4dea-81ec-8ba887f9a678 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:13.309131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab085a-59f1-4dea-81ec-8ba887f9a678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:13.326840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-aaab085a-59f1-4dea-81ec-8ba887f9a678 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:13.328018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-aaab085a-59f1-4dea-81ec-8ba887f9a678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:13.392964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 565/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:13.416344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d851571-cec3-4537-a291-21437b247fdc None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:13.515623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d851571-cec3-4537-a291-21437b247fdc None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:13.535595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:13.549253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963b90e-47b9-42fc-8af9-90c17a11b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:13.549864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b90e-47b9-42fc-8af9-90c17a11b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:13.550175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b90e-47b9-42fc-8af9-90c17a11b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:13.550458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b90e-47b9-42fc-8af9-90c17a11b6a2 None admin] PATH_INFO: `/v3/roles/45f0e969ef594665877c4596781ce6aa` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:13.551888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963b90e-47b9-42fc-8af9-90c17a11b6a2 None admin] RBAC: Authorizing `identity:get_role(role_id=45f0e969ef594665877c4596781ce6aa)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:13.553209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963b90e-47b9-42fc-8af9-90c17a11b6a2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:13.554538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 561/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:13 2022] GET /identity/v3/roles/45f0e969ef594665877c4596781ce6aa => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:13.560144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab085a-59f1-4dea-81ec-8ba887f9a678 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:13.610682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:13.658469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab085a-59f1-4dea-81ec-8ba887f9a678 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:13.691107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec3b7-bd42-4c40-ac94-5f8aecab9990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:13.691721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec3b7-bd42-4c40-ac94-5f8aecab9990 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:13.691999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec3b7-bd42-4c40-ac94-5f8aecab9990 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:13.692273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec3b7-bd42-4c40-ac94-5f8aecab9990 None admin] PATH_INFO: `/v3/users/f3f8c7c2bb884e919049324566717a63` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:13.693372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ec3b7-bd42-4c40-ac94-5f8aecab9990 None admin] RBAC: Authorizing `identity:get_user(user_id=f3f8c7c2bb884e919049324566717a63)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:13.694821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ec3b7-bd42-4c40-ac94-5f8aecab9990 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:13.696379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 566/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:13 2022] GET /identity/v3/users/f3f8c7c2bb884e919049324566717a63 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:13.702646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963b90e-47b9-42fc-8af9-90c17a11b6a2 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:13.799739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963b90e-47b9-42fc-8af9-90c17a11b6a2 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:13.832359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5405-661e-4e9c-8882-059e0cdb34c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:13.832890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5405-661e-4e9c-8882-059e0cdb34c5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:13.833173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5405-661e-4e9c-8882-059e0cdb34c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:13.833450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5405-661e-4e9c-8882-059e0cdb34c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:13.887555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:13.901018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5405-661e-4e9c-8882-059e0cdb34c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:13.902507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5405-661e-4e9c-8882-059e0cdb34c5 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:13.996846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 562/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:17:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:17:14.003213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec3b7-bd42-4c40-ac94-5f8aecab9990 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:14.097985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec3b7-bd42-4c40-ac94-5f8aecab9990 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:14.116903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:14.131235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e384e82-8e43-48c4-a987-f85e9ec8caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:14.131852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384e82-8e43-48c4-a987-f85e9ec8caaa None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:14.132131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384e82-8e43-48c4-a987-f85e9ec8caaa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:14.132401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384e82-8e43-48c4-a987-f85e9ec8caaa None admin] PATH_INFO: `/v3/projects/1e304b36c9df4aaf9384376c64c33563` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:14.133490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e384e82-8e43-48c4-a987-f85e9ec8caaa None admin] RBAC: Authorizing `identity:get_project(project_id=1e304b36c9df4aaf9384376c64c33563)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:14.134934 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e384e82-8e43-48c4-a987-f85e9ec8caaa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:14.136528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 567/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:14 2022] GET /identity/v3/projects/1e304b36c9df4aaf9384376c64c33563 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:14.143380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5405-661e-4e9c-8882-059e0cdb34c5 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:14.228384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:14.241001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5405-661e-4e9c-8882-059e0cdb34c5 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:14.274627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198641-76e1-4807-86a2-5cb624fe1fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:14.275215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198641-76e1-4807-86a2-5cb624fe1fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:14.275497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198641-76e1-4807-86a2-5cb624fe1fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:14.275773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198641-76e1-4807-86a2-5cb624fe1fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:14.276488 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198641-76e1-4807-86a2-5cb624fe1fe6 None admin] RBAC: Adding query filter params (role.id=45f0e969ef594665877c4596781ce6aa, scope.project.id=1e304b36c9df4aaf9384376c64c33563, user.id=f3f8c7c2bb884e919049324566717a63) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:14.276797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198641-76e1-4807-86a2-5cb624fe1fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:14.278244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198641-76e1-4807-86a2-5cb624fe1fe6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:14.286810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 563/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:17:14 2022] GET /identity/v3/role_assignments?user.id=f3f8c7c2bb884e919049324566717a63&scope.project.id=1e304b36c9df4aaf9384376c64c33563&role.id=45f0e969ef594665877c4596781ce6aa => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:17:16.281230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb03a-aded-401b-95e0-b48c4426a645 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:16.281781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb03a-aded-401b-95e0-b48c4426a645 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:16.281781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb03a-aded-401b-95e0-b48c4426a645 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:16.283154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 568/1131] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:16.288160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fee45-29f0-4d96-90e3-e4628c789eb3 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:16.288545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fee45-29f0-4d96-90e3-e4628c789eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:16.288712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fee45-29f0-4d96-90e3-e4628c789eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:16.306102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-788fee45-29f0-4d96-90e3-e4628c789eb3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:16.307269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-788fee45-29f0-4d96-90e3-e4628c789eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:16.370439 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 564/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:16.394166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbb03a-aded-401b-95e0-b48c4426a645 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:16.491549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbb03a-aded-401b-95e0-b48c4426a645 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:16.526231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422653-7955-4c89-8a69-5566f33182ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:16.526851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422653-7955-4c89-8a69-5566f33182ea None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:16.527132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422653-7955-4c89-8a69-5566f33182ea None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:16.527407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422653-7955-4c89-8a69-5566f33182ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:16.528503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422653-7955-4c89-8a69-5566f33182ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:16.529943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422653-7955-4c89-8a69-5566f33182ea None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:16.531592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 569/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:17:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:16.537430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fee45-29f0-4d96-90e3-e4628c789eb3 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:16.615479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:16.633616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fee45-29f0-4d96-90e3-e4628c789eb3 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:16.665598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0b51-9990-489b-9028-3ee3e6e6389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:16.666216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0b51-9990-489b-9028-3ee3e6e6389b None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:16.666496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0b51-9990-489b-9028-3ee3e6e6389b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:16.666767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0b51-9990-489b-9028-3ee3e6e6389b None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:16.667402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0b51-9990-489b-9028-3ee3e6e6389b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:16.668824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0b51-9990-489b-9028-3ee3e6e6389b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:16.695569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 565/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:17:16 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:17:18.702883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5e89-4867-48b4-a1ee-3727e738db9f None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:18.703413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5e89-4867-48b4-a1ee-3727e738db9f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:18.703413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5e89-4867-48b4-a1ee-3727e738db9f None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:18.704774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 570/1135] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:18.709844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1c3d2-aa58-4802-9131-71432c1124f1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:18.710278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1c3d2-aa58-4802-9131-71432c1124f1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:18.710429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1c3d2-aa58-4802-9131-71432c1124f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:18.728533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-40f1c3d2-aa58-4802-9131-71432c1124f1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:18.729704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-40f1c3d2-aa58-4802-9131-71432c1124f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:18.793883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 566/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:18.817581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5e89-4867-48b4-a1ee-3727e738db9f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:18.875054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:18.918417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5e89-4867-48b4-a1ee-3727e738db9f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:18.950081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f01d1-d21a-43b8-a460-c3d0c81ddb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:18.950706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f01d1-d21a-43b8-a460-c3d0c81ddb5a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:18.951507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f01d1-d21a-43b8-a460-c3d0c81ddb5a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:18.951775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f01d1-d21a-43b8-a460-c3d0c81ddb5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:18.952858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f01d1-d21a-43b8-a460-c3d0c81ddb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:18.954329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f01d1-d21a-43b8-a460-c3d0c81ddb5a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:18.955819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 571/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:17:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:18.961474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1c3d2-aa58-4802-9131-71432c1124f1 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:19.020432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:19.057560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1c3d2-aa58-4802-9131-71432c1124f1 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:19.089749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8ed96-3b32-439a-bf15-c759a450e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:19.090359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ed96-3b32-439a-bf15-c759a450e57f None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:19.090636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ed96-3b32-439a-bf15-c759a450e57f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:19.090901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ed96-3b32-439a-bf15-c759a450e57f None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:19.092129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8ed96-3b32-439a-bf15-c759a450e57f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:19.093546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8ed96-3b32-439a-bf15-c759a450e57f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:19.112907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 567/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:17:18 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:17:21.134011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9b173-3962-4a58-9986-592b8140c3f3 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:21.134556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9b173-3962-4a58-9986-592b8140c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:21.134556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9b173-3962-4a58-9986-592b8140c3f3 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:21.135889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 572/1139] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:21.141036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9477c49-ca91-4dbc-bbb1-9cdeb56b5ada None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:21.141413 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9477c49-ca91-4dbc-bbb1-9cdeb56b5ada None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:21.141585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9477c49-ca91-4dbc-bbb1-9cdeb56b5ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:21.159436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f9477c49-ca91-4dbc-bbb1-9cdeb56b5ada None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:21.160596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f9477c49-ca91-4dbc-bbb1-9cdeb56b5ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:21.224425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 568/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:21.247534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9b173-3962-4a58-9986-592b8140c3f3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:21.346145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9b173-3962-4a58-9986-592b8140c3f3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:21.368997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:21.380297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73abec-46b2-470b-b262-3bf0a356e16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:21.380911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73abec-46b2-470b-b262-3bf0a356e16f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:21.381194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73abec-46b2-470b-b262-3bf0a356e16f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:21.381468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73abec-46b2-470b-b262-3bf0a356e16f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:21.391387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73abec-46b2-470b-b262-3bf0a356e16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-9c73abec-46b2-470b-b262-3bf0a356e16f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:17:21.396241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:17:21.397399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:17:21.398562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 573/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:17:21.403398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9477c49-ca91-4dbc-bbb1-9cdeb56b5ada None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:21.452752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:21.502490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9477c49-ca91-4dbc-bbb1-9cdeb56b5ada None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:21.535573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:21.536168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:21.536452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:21.536727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:21.537383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:21.537690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:21.539078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:21.547471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 569/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:21.553586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73abec-46b2-470b-b262-3bf0a356e16f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:21.648212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73abec-46b2-470b-b262-3bf0a356e16f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:21.681329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fa88c-f79c-4e5d-9b1e-68c31b0fe758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:21.681933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fa88c-f79c-4e5d-9b1e-68c31b0fe758 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:21.682241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fa88c-f79c-4e5d-9b1e-68c31b0fe758 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:21.682515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fa88c-f79c-4e5d-9b1e-68c31b0fe758 None admin] PATH_INFO: `/v3/users/c0d2dfcc70f547359727e25b83321fe0` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:21.695702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fa88c-f79c-4e5d-9b1e-68c31b0fe758 None admin] RBAC: Authorizing `identity:get_user(user_id=c0d2dfcc70f547359727e25b83321fe0)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:21.697112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fa88c-f79c-4e5d-9b1e-68c31b0fe758 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:21.698709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 574/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:21 2022] GET /identity/v3/users/c0d2dfcc70f547359727e25b83321fe0 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:21.704688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:21.802146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92f19-02f6-435f-b0f7-5603a87ac818 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:21.814296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:21.835476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7342133-d7fd-4f35-ac8f-45691bc29e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:21.836067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342133-d7fd-4f35-ac8f-45691bc29e10 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:21.836342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342133-d7fd-4f35-ac8f-45691bc29e10 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:21.836610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342133-d7fd-4f35-ac8f-45691bc29e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:21.901033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7342133-d7fd-4f35-ac8f-45691bc29e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:21.902478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7342133-d7fd-4f35-ac8f-45691bc29e10 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:21.995855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 570/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:17:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:17:22.001925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fa88c-f79c-4e5d-9b1e-68c31b0fe758 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:22.044445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:22.097836 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fa88c-f79c-4e5d-9b1e-68c31b0fe758 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:22.130085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b525de-af52-4c65-9d68-91cb3c160b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:22.130708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b525de-af52-4c65-9d68-91cb3c160b35 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:22.130987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b525de-af52-4c65-9d68-91cb3c160b35 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:22.131257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b525de-af52-4c65-9d68-91cb3c160b35 None admin] PATH_INFO: `/v3/projects/a36d3e9e1fab4774856349eca0ab3442` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:22.132340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b525de-af52-4c65-9d68-91cb3c160b35 None admin] RBAC: Authorizing `identity:get_project(project_id=a36d3e9e1fab4774856349eca0ab3442)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:22.133734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b525de-af52-4c65-9d68-91cb3c160b35 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:22.135345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 575/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:22 2022] GET /identity/v3/projects/a36d3e9e1fab4774856349eca0ab3442 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:22.141936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7342133-d7fd-4f35-ac8f-45691bc29e10 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:22.155894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:22.237279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7342133-d7fd-4f35-ac8f-45691bc29e10 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:22.270496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e082bb4-eb9c-4558-ba3d-8609a1aed976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:22.271078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082bb4-eb9c-4558-ba3d-8609a1aed976 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:22.271354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082bb4-eb9c-4558-ba3d-8609a1aed976 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:22.271625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082bb4-eb9c-4558-ba3d-8609a1aed976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:22.272328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e082bb4-eb9c-4558-ba3d-8609a1aed976 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=a36d3e9e1fab4774856349eca0ab3442, user.id=c0d2dfcc70f547359727e25b83321fe0) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:22.272633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e082bb4-eb9c-4558-ba3d-8609a1aed976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:22.274041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e082bb4-eb9c-4558-ba3d-8609a1aed976 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:22.279177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 571/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:17:22 2022] GET /identity/v3/role_assignments?user.id=c0d2dfcc70f547359727e25b83321fe0&scope.project.id=a36d3e9e1fab4774856349eca0ab3442&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:24.214554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e673-e96c-4415-a94b-a08433cd8df2 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:24.215140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e673-e96c-4415-a94b-a08433cd8df2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:24.215140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e673-e96c-4415-a94b-a08433cd8df2 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:24.216940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 576/1147] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:24.222096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe18c4-492f-4145-8043-4f65a61203ed None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:24.222471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe18c4-492f-4145-8043-4f65a61203ed None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:24.222659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe18c4-492f-4145-8043-4f65a61203ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:24.240131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-44fe18c4-492f-4145-8043-4f65a61203ed None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:24.241324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-44fe18c4-492f-4145-8043-4f65a61203ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:24.304647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 572/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:24.326586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e673-e96c-4415-a94b-a08433cd8df2 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:24.424020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e673-e96c-4415-a94b-a08433cd8df2 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:24.434171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:24.457967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f78b7-7724-4d99-8913-67f20a2c534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:24.458607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f78b7-7724-4d99-8913-67f20a2c534f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:24.458886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f78b7-7724-4d99-8913-67f20a2c534f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:24.459158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f78b7-7724-4d99-8913-67f20a2c534f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:24.468827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f78b7-7724-4d99-8913-67f20a2c534f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-2f8f78b7-7724-4d99-8913-67f20a2c534f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:17:24.473426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:17:24.474630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:17:24.475559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 577/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:17:24.480521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe18c4-492f-4145-8043-4f65a61203ed None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:24.489100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:24.580337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe18c4-492f-4145-8043-4f65a61203ed None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:24.612631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:24.613221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:24.613502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:24.613773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:24.614483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:24.614787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:24.616152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:24.624418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 573/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:24.630445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f78b7-7724-4d99-8913-67f20a2c534f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:24.730823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f78b7-7724-4d99-8913-67f20a2c534f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:24.764314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429486-934c-487a-853d-e9ae4bca540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:24.764922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429486-934c-487a-853d-e9ae4bca540f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:24.765203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429486-934c-487a-853d-e9ae4bca540f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:24.765473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429486-934c-487a-853d-e9ae4bca540f None admin] PATH_INFO: `/v3/users/c0d2dfcc70f547359727e25b83321fe0` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:24.766669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85429486-934c-487a-853d-e9ae4bca540f None admin] RBAC: Authorizing `identity:get_user(user_id=c0d2dfcc70f547359727e25b83321fe0)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:24.768342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85429486-934c-487a-853d-e9ae4bca540f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:24.769898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 578/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:24 2022] GET /identity/v3/users/c0d2dfcc70f547359727e25b83321fe0 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:24.775633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:24.840115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:24.873790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12e0a5-c9b9-4032-97f3-b78a7b973936 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:24.906139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952d154-e19d-46ca-91a8-760e02dc14c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:24.906758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d154-e19d-46ca-91a8-760e02dc14c5 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:24.907042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d154-e19d-46ca-91a8-760e02dc14c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:24.907347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d154-e19d-46ca-91a8-760e02dc14c5 None admin] PATH_INFO: `/v3/projects/a36d3e9e1fab4774856349eca0ab3442` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:24.908470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952d154-e19d-46ca-91a8-760e02dc14c5 None admin] RBAC: Authorizing `identity:get_project(project_id=a36d3e9e1fab4774856349eca0ab3442)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:24.909928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952d154-e19d-46ca-91a8-760e02dc14c5 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:24.911587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 574/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:24 2022] GET /identity/v3/projects/a36d3e9e1fab4774856349eca0ab3442 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:24.917443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429486-934c-487a-853d-e9ae4bca540f None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:24.956239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:25.013496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429486-934c-487a-853d-e9ae4bca540f None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:25.046316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b906e5-711e-4a35-8629-301fb526bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:25.046954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b906e5-711e-4a35-8629-301fb526bffa None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:25.047234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b906e5-711e-4a35-8629-301fb526bffa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:25.047506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b906e5-711e-4a35-8629-301fb526bffa None admin] PATH_INFO: `/v3/projects/a36d3e9e1fab4774856349eca0ab3442/users/c0d2dfcc70f547359727e25b83321fe0/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:25.049360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b906e5-711e-4a35-8629-301fb526bffa None admin] RBAC: Authorizing `identity:create_grant(project_id=a36d3e9e1fab4774856349eca0ab3442, user_id=c0d2dfcc70f547359727e25b83321fe0, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:25.050786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b906e5-711e-4a35-8629-301fb526bffa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:25.063581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 579/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:17:24 2022] PUT /identity/v3/projects/a36d3e9e1fab4774856349eca0ab3442/users/c0d2dfcc70f547359727e25b83321fe0/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:17:27.030618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5367-5da5-4a90-a54f-63f449474ba7 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:27.031120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5367-5da5-4a90-a54f-63f449474ba7 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:27.031210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5367-5da5-4a90-a54f-63f449474ba7 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:27.032506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 575/1154] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:27.037712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3271b-264c-4f03-ae43-d80907f97d2e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:27.038145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3271b-264c-4f03-ae43-d80907f97d2e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:27.038304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3271b-264c-4f03-ae43-d80907f97d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:27.055797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c0e3271b-264c-4f03-ae43-d80907f97d2e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:27.056952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c0e3271b-264c-4f03-ae43-d80907f97d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:27.120707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 580/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:27.143613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c5367-5da5-4a90-a54f-63f449474ba7 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:27.242028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c5367-5da5-4a90-a54f-63f449474ba7 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:27.274604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec75e8-19aa-4a83-aefd-d0b0bdefcfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:27.275203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec75e8-19aa-4a83-aefd-d0b0bdefcfd9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:27.275482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec75e8-19aa-4a83-aefd-d0b0bdefcfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:27.275753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec75e8-19aa-4a83-aefd-d0b0bdefcfd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:27.278291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:27.286755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec75e8-19aa-4a83-aefd-d0b0bdefcfd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-70ec75e8-19aa-4a83-aefd-d0b0bdefcfd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:17:27.291320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:17:27.292423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:17:27.293264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 576/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:17:27.298509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3271b-264c-4f03-ae43-d80907f97d2e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:27.324721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:27.394908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3271b-264c-4f03-ae43-d80907f97d2e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:27.426531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:27.427123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:27.427399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:27.427668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:27.428316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:27.428618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:27.429962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:27.438228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 581/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:27.443834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec75e8-19aa-4a83-aefd-d0b0bdefcfd9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:27.538971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec75e8-19aa-4a83-aefd-d0b0bdefcfd9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:27.571092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97484799-6d4d-4f02-a690-9c29fa77349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:27.571682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97484799-6d4d-4f02-a690-9c29fa77349f None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:27.571959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97484799-6d4d-4f02-a690-9c29fa77349f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:27.572227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97484799-6d4d-4f02-a690-9c29fa77349f None admin] PATH_INFO: `/v3/users/c0d2dfcc70f547359727e25b83321fe0` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:27.573311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97484799-6d4d-4f02-a690-9c29fa77349f None admin] RBAC: Authorizing `identity:get_user(user_id=c0d2dfcc70f547359727e25b83321fe0)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:27.574750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97484799-6d4d-4f02-a690-9c29fa77349f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:27.577453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 577/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:27 2022] GET /identity/v3/users/c0d2dfcc70f547359727e25b83321fe0 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:27.583467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:27.673961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:27.684431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bb1e-fa85-4ba5-b117-37cb41fe1b4e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:27.717573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b916aa-c59e-4bee-b3e4-cd55f7205519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:27.718197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b916aa-c59e-4bee-b3e4-cd55f7205519 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:27.718479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b916aa-c59e-4bee-b3e4-cd55f7205519 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:27.718749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b916aa-c59e-4bee-b3e4-cd55f7205519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:27.783015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b916aa-c59e-4bee-b3e4-cd55f7205519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:27.784439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b916aa-c59e-4bee-b3e4-cd55f7205519 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:27.875459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:27.885655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 582/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:17:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:17:27.892017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97484799-6d4d-4f02-a690-9c29fa77349f None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:27.958365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:27.996020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97484799-6d4d-4f02-a690-9c29fa77349f None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:28.029249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96f24e-ddfc-4899-9984-7c5cda013432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:28.029874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96f24e-ddfc-4899-9984-7c5cda013432 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:28.030181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96f24e-ddfc-4899-9984-7c5cda013432 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:28.030455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96f24e-ddfc-4899-9984-7c5cda013432 None admin] PATH_INFO: `/v3/projects/a36d3e9e1fab4774856349eca0ab3442` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:28.031559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96f24e-ddfc-4899-9984-7c5cda013432 None admin] RBAC: Authorizing `identity:get_project(project_id=a36d3e9e1fab4774856349eca0ab3442)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:28.032990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96f24e-ddfc-4899-9984-7c5cda013432 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:28.034655 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 578/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:27 2022] GET /identity/v3/projects/a36d3e9e1fab4774856349eca0ab3442 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:28.040795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b916aa-c59e-4bee-b3e4-cd55f7205519 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:28.135560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b916aa-c59e-4bee-b3e4-cd55f7205519 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:28.168170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9a54-907e-4a6d-ac01-9f432c5907c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:28.168757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9a54-907e-4a6d-ac01-9f432c5907c3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:28.169034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9a54-907e-4a6d-ac01-9f432c5907c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:28.169331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9a54-907e-4a6d-ac01-9f432c5907c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:28.170031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9a54-907e-4a6d-ac01-9f432c5907c3 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=a36d3e9e1fab4774856349eca0ab3442, user.id=c0d2dfcc70f547359727e25b83321fe0) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:28.170366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9a54-907e-4a6d-ac01-9f432c5907c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:28.171759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9a54-907e-4a6d-ac01-9f432c5907c3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:28.177250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 583/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:17:28 2022] GET /identity/v3/role_assignments?user.id=c0d2dfcc70f547359727e25b83321fe0&scope.project.id=a36d3e9e1fab4774856349eca0ab3442&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:17:30.153098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413de22-907e-4db4-b33a-bd5f181134c2 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:30.154198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413de22-907e-4db4-b33a-bd5f181134c2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:30.154296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413de22-907e-4db4-b33a-bd5f181134c2 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:30.155639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 579/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:30.160777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41def0bf-747c-4dbd-9eef-860cff489052 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:30.161164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41def0bf-747c-4dbd-9eef-860cff489052 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:30.161325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41def0bf-747c-4dbd-9eef-860cff489052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:30.179020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-41def0bf-747c-4dbd-9eef-860cff489052 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:30.180199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-41def0bf-747c-4dbd-9eef-860cff489052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:30.227959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:30.245211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 584/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:30.267648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413de22-907e-4db4-b33a-bd5f181134c2 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:30.366765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413de22-907e-4db4-b33a-bd5f181134c2 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:30.395782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:30.401037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1f478-d703-4432-830e-95b7d32adb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:30.401629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f478-d703-4432-830e-95b7d32adb4b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:30.401907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f478-d703-4432-830e-95b7d32adb4b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:30.402209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f478-d703-4432-830e-95b7d32adb4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:30.465920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1f478-d703-4432-830e-95b7d32adb4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:30.467403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1f478-d703-4432-830e-95b7d32adb4b None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:30.560753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 580/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:17:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:17:30.566699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41def0bf-747c-4dbd-9eef-860cff489052 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:30.664922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41def0bf-747c-4dbd-9eef-860cff489052 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:30.698802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f8b64-96b6-4c70-9b20-c7324a344a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:30.699419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f8b64-96b6-4c70-9b20-c7324a344a92 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:30.699699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f8b64-96b6-4c70-9b20-c7324a344a92 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:30.699972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f8b64-96b6-4c70-9b20-c7324a344a92 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:30.707027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f8b64-96b6-4c70-9b20-c7324a344a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:30.708458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f8b64-96b6-4c70-9b20-c7324a344a92 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-570f8b64-96b6-4c70-9b20-c7324a344a92 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:17:30.719655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:17:30.720860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:17:30.721920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 585/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:17:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:17:30.726885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1f478-d703-4432-830e-95b7d32adb4b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:30.756971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:30.823048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1f478-d703-4432-830e-95b7d32adb4b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:30.856138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050312-6059-479e-9671-677b9641f785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:30.856737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050312-6059-479e-9671-677b9641f785 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:30.857014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050312-6059-479e-9671-677b9641f785 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:30.857285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050312-6059-479e-9671-677b9641f785 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:30.857919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050312-6059-479e-9671-677b9641f785 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:30.858248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050312-6059-479e-9671-677b9641f785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:30.859603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050312-6059-479e-9671-677b9641f785 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:30.866601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 581/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Aug 8 00:17:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:32.847354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f6075-85f1-438d-b04d-a672db4025a2 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:32.847949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f6075-85f1-438d-b04d-a672db4025a2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:32.847949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f6075-85f1-438d-b04d-a672db4025a2 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:32.849240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 586/1167] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:32.854717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45e82-f25e-43ac-8f36-4a9be48c3285 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:32.855101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45e82-f25e-43ac-8f36-4a9be48c3285 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:32.855258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45e82-f25e-43ac-8f36-4a9be48c3285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:32.873318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-5eb45e82-f25e-43ac-8f36-4a9be48c3285 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:32.874781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5eb45e82-f25e-43ac-8f36-4a9be48c3285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:32.938874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 582/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:32.961134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f6075-85f1-438d-b04d-a672db4025a2 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:33.006737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:33.060801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f6075-85f1-438d-b04d-a672db4025a2 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:33.092758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60464dbb-2fdc-4db3-ace0-37f54b12d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:33.093345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464dbb-2fdc-4db3-ace0-37f54b12d5a7 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:33.093623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464dbb-2fdc-4db3-ace0-37f54b12d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:33.093894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464dbb-2fdc-4db3-ace0-37f54b12d5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:33.094567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60464dbb-2fdc-4db3-ace0-37f54b12d5a7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:33.095913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60464dbb-2fdc-4db3-ace0-37f54b12d5a7 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:33.111436 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 587/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Aug 8 00:17:32 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:17:35.096697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9847c-137b-4ae7-84d2-ce6e7b9bd501 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:35.097208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9847c-137b-4ae7-84d2-ce6e7b9bd501 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:35.097293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9847c-137b-4ae7-84d2-ce6e7b9bd501 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:35.098628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 583/1170] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:35.103854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce0e0-f292-463f-9f2d-1bc8894969b4 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:35.104242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce0e0-f292-463f-9f2d-1bc8894969b4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:35.104329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce0e0-f292-463f-9f2d-1bc8894969b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:35.122519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-112ce0e0-f292-463f-9f2d-1bc8894969b4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:35.123691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-112ce0e0-f292-463f-9f2d-1bc8894969b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:35.188648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 588/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:35.211612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9847c-137b-4ae7-84d2-ce6e7b9bd501 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:35.238071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:35.310417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9847c-137b-4ae7-84d2-ce6e7b9bd501 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:35.342133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30c8f-8c80-4225-b858-55731a78ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:35.342731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30c8f-8c80-4225-b858-55731a78ec39 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:35.343007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30c8f-8c80-4225-b858-55731a78ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:35.343275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30c8f-8c80-4225-b858-55731a78ec39 None admin] PATH_INFO: `/v3/domains/d959b9c5da544f6e92f28452bde4b5ad` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:35.353176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30c8f-8c80-4225-b858-55731a78ec39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d959b9c5da544f6e92f28452bde4b5ad)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:35.354685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30c8f-8c80-4225-b858-55731a78ec39 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:35.356170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 584/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Aug 8 00:17:35 2022] GET /identity/v3/domains/d959b9c5da544f6e92f28452bde4b5ad => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:35.362415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce0e0-f292-463f-9f2d-1bc8894969b4 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:35.395024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:35.458653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce0e0-f292-463f-9f2d-1bc8894969b4 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:35.490715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52c38-8827-49d4-8b49-71f7664be1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:35.491304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52c38-8827-49d4-8b49-71f7664be1c4 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:35.491581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52c38-8827-49d4-8b49-71f7664be1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:35.491849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52c38-8827-49d4-8b49-71f7664be1c4 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:35.492473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52c38-8827-49d4-8b49-71f7664be1c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:35.493868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52c38-8827-49d4-8b49-71f7664be1c4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:35.519032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 589/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:17:35 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:17:37.507763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd648a2-a3a9-47ef-af01-9b773faf83fd None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:37.508286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd648a2-a3a9-47ef-af01-9b773faf83fd None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:37.508376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd648a2-a3a9-47ef-af01-9b773faf83fd None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:37.509687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 585/1174] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:37.515240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac29cf-333f-4f64-ab9a-ba8defde01b3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:37.515649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac29cf-333f-4f64-ab9a-ba8defde01b3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:37.515788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac29cf-333f-4f64-ab9a-ba8defde01b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:37.534173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c0ac29cf-333f-4f64-ab9a-ba8defde01b3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:37.535335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c0ac29cf-333f-4f64-ab9a-ba8defde01b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:37.597668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 590/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:37.621475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd648a2-a3a9-47ef-af01-9b773faf83fd None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:37.706693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:37.723048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd648a2-a3a9-47ef-af01-9b773faf83fd None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:37.757273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8b5b2-8616-4cd2-9041-0e013b840370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:37.757954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b5b2-8616-4cd2-9041-0e013b840370 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:37.758211 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b5b2-8616-4cd2-9041-0e013b840370 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:37.758483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b5b2-8616-4cd2-9041-0e013b840370 None admin] PATH_INFO: `/v3/domains/d959b9c5da544f6e92f28452bde4b5ad` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:37.759584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8b5b2-8616-4cd2-9041-0e013b840370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d959b9c5da544f6e92f28452bde4b5ad)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:37.761007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8b5b2-8616-4cd2-9041-0e013b840370 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:37.767404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 586/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Aug 8 00:17:37 2022] GET /identity/v3/domains/d959b9c5da544f6e92f28452bde4b5ad => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:37.769316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac29cf-333f-4f64-ab9a-ba8defde01b3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:37.788455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:37.874510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac29cf-333f-4f64-ab9a-ba8defde01b3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:37.908457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e66b5-84b2-4dd5-a47b-c962dec62ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:37.909067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e66b5-84b2-4dd5-a47b-c962dec62ec4 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:37.909346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e66b5-84b2-4dd5-a47b-c962dec62ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:37.909647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e66b5-84b2-4dd5-a47b-c962dec62ec4 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:37.910328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e66b5-84b2-4dd5-a47b-c962dec62ec4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:37.911747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e66b5-84b2-4dd5-a47b-c962dec62ec4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:37.931911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 591/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:17:37 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:17:39.953330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6822-08c1-4864-b6d5-7032384fc6a6 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:39.953866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6822-08c1-4864-b6d5-7032384fc6a6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:39.953866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6822-08c1-4864-b6d5-7032384fc6a6 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:39.955244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 587/1178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:39.960242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5bb0-604b-4420-ab3e-e20dc011857f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:39.960624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5bb0-604b-4420-ab3e-e20dc011857f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:39.960789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f5bb0-604b-4420-ab3e-e20dc011857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:39.979547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ca2f5bb0-604b-4420-ab3e-e20dc011857f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:39.980707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ca2f5bb0-604b-4420-ab3e-e20dc011857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:40.044361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 592/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:40.066592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e6822-08c1-4864-b6d5-7032384fc6a6 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:40.164755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e6822-08c1-4864-b6d5-7032384fc6a6 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:40.197106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b7ea-84bb-40a4-9b0f-d667ccaef670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:40.197707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b7ea-84bb-40a4-9b0f-d667ccaef670 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:40.197986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b7ea-84bb-40a4-9b0f-d667ccaef670 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:40.198284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b7ea-84bb-40a4-9b0f-d667ccaef670 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:40.208513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1b7ea-84bb-40a4-9b0f-d667ccaef670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-a2b1b7ea-84bb-40a4-9b0f-d667ccaef670 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:17:40.213085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:17:40.214254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:17:40.215528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 588/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:17:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:17:40.220096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f5bb0-604b-4420-ab3e-e20dc011857f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:40.222254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:40.315787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f5bb0-604b-4420-ab3e-e20dc011857f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:40.348000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:40.348584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:40.348860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:40.349127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:40.349767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:40.350095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:40.351566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:40.359223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 593/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:17:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:40.364726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b7ea-84bb-40a4-9b0f-d667ccaef670 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:40.380940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:40.465899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b7ea-84bb-40a4-9b0f-d667ccaef670 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:40.499405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6068c4e-3090-4b83-9940-deb3a69fde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:40.500044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068c4e-3090-4b83-9940-deb3a69fde00 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:40.500324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068c4e-3090-4b83-9940-deb3a69fde00 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:40.500597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068c4e-3090-4b83-9940-deb3a69fde00 None admin] PATH_INFO: `/v3/users/6b6c0028addd47a6b677353b9536998e` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:40.513086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6068c4e-3090-4b83-9940-deb3a69fde00 None admin] RBAC: Authorizing `identity:get_user(user_id=6b6c0028addd47a6b677353b9536998e)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:40.514553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6068c4e-3090-4b83-9940-deb3a69fde00 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:40.516120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 589/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:40 2022] GET /identity/v3/users/6b6c0028addd47a6b677353b9536998e => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:40.522086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:40.581619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:40.618127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cb2b7-1695-42b3-9ba9-e5a8c03c1c83 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:40.650469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b23dc-1766-4afc-95a9-26702192019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:40.651049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b23dc-1766-4afc-95a9-26702192019d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:40.651326 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b23dc-1766-4afc-95a9-26702192019d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:40.651593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b23dc-1766-4afc-95a9-26702192019d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:40.714926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b23dc-1766-4afc-95a9-26702192019d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:40.716417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b23dc-1766-4afc-95a9-26702192019d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:40.773491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:40.811063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 594/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:17:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:17:40.816986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6068c4e-3090-4b83-9940-deb3a69fde00 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:40.884765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:40.913435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6068c4e-3090-4b83-9940-deb3a69fde00 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:40.945876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c760b-6371-477a-a34c-7d676447a18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:40.946512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c760b-6371-477a-a34c-7d676447a18d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:40.946789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c760b-6371-477a-a34c-7d676447a18d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:40.947057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c760b-6371-477a-a34c-7d676447a18d None admin] PATH_INFO: `/v3/projects/e1e42d50b50442e5bce02f3e8af543af` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:40.948140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c760b-6371-477a-a34c-7d676447a18d None admin] RBAC: Authorizing `identity:get_project(project_id=e1e42d50b50442e5bce02f3e8af543af)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:40.949549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c760b-6371-477a-a34c-7d676447a18d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:40.951216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 590/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:40 2022] GET /identity/v3/projects/e1e42d50b50442e5bce02f3e8af543af => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:40.957381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b23dc-1766-4afc-95a9-26702192019d None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:41.052507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b23dc-1766-4afc-95a9-26702192019d None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:41.084630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a596f4-a359-4bd8-a41e-2e6f536ea6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:41.085207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a596f4-a359-4bd8-a41e-2e6f536ea6a1 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:41.085483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a596f4-a359-4bd8-a41e-2e6f536ea6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:41.085754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a596f4-a359-4bd8-a41e-2e6f536ea6a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:41.086479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a596f4-a359-4bd8-a41e-2e6f536ea6a1 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=e1e42d50b50442e5bce02f3e8af543af, user.id=6b6c0028addd47a6b677353b9536998e) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:41.086785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a596f4-a359-4bd8-a41e-2e6f536ea6a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:41.088187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a596f4-a359-4bd8-a41e-2e6f536ea6a1 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:41.093947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 595/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:17:40 2022] GET /identity/v3/role_assignments?user.id=6b6c0028addd47a6b677353b9536998e&scope.project.id=e1e42d50b50442e5bce02f3e8af543af&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:43.037808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1036a-e4ad-4afa-abd8-9835794c2e8f None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:43.038374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1036a-e4ad-4afa-abd8-9835794c2e8f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:43.038374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1036a-e4ad-4afa-abd8-9835794c2e8f None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:43.039708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 591/1186] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:43.044983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa912f-1793-4cdf-ac9e-79bf6fb51e3e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:43.045401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa912f-1793-4cdf-ac9e-79bf6fb51e3e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:43.045535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa912f-1793-4cdf-ac9e-79bf6fb51e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:43.063092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-89fa912f-1793-4cdf-ac9e-79bf6fb51e3e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:43.064262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-89fa912f-1793-4cdf-ac9e-79bf6fb51e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:43.086493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:43.130175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 596/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:43.152882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1036a-e4ad-4afa-abd8-9835794c2e8f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:43.249925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1036a-e4ad-4afa-abd8-9835794c2e8f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:43.282381 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9b04-7d35-4706-8be6-f6099c88298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:43.282981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9b04-7d35-4706-8be6-f6099c88298a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:43.283257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9b04-7d35-4706-8be6-f6099c88298a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:43.283524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9b04-7d35-4706-8be6-f6099c88298a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:43.290716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:43.293797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd9b04-7d35-4706-8be6-f6099c88298a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-79dd9b04-7d35-4706-8be6-f6099c88298a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:17:43.298521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:17:43.299606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:17:43.300787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 592/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:17:43.305507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa912f-1793-4cdf-ac9e-79bf6fb51e3e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:43.407544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa912f-1793-4cdf-ac9e-79bf6fb51e3e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:43.440128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:43.440723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:43.441001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:43.441270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:43.441919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:43.442250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:43.443607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:43.451953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 597/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:17:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:43.457929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9b04-7d35-4706-8be6-f6099c88298a None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:43.555149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9b04-7d35-4706-8be6-f6099c88298a None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:43.587852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc90e8-7f54-4589-9d88-5977923802b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:43.588440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc90e8-7f54-4589-9d88-5977923802b2 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:43.588724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc90e8-7f54-4589-9d88-5977923802b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:43.589001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc90e8-7f54-4589-9d88-5977923802b2 None admin] PATH_INFO: `/v3/users/6b6c0028addd47a6b677353b9536998e` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:43.590125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc90e8-7f54-4589-9d88-5977923802b2 None admin] RBAC: Authorizing `identity:get_user(user_id=6b6c0028addd47a6b677353b9536998e)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:43.591586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc90e8-7f54-4589-9d88-5977923802b2 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:43.593129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 593/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:43 2022] GET /identity/v3/users/6b6c0028addd47a6b677353b9536998e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:43.598625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:43.620502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:43.695764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983371-7e58-4a54-bb17-debdf0e93622 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:43.728540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d971e6-dac5-4f66-be33-b48a8dafdbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:43.729160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d971e6-dac5-4f66-be33-b48a8dafdbaa None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:43.729440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d971e6-dac5-4f66-be33-b48a8dafdbaa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:43.729712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d971e6-dac5-4f66-be33-b48a8dafdbaa None admin] PATH_INFO: `/v3/projects/e1e42d50b50442e5bce02f3e8af543af` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:43.730838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d971e6-dac5-4f66-be33-b48a8dafdbaa None admin] RBAC: Authorizing `identity:get_project(project_id=e1e42d50b50442e5bce02f3e8af543af)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:43.732769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d971e6-dac5-4f66-be33-b48a8dafdbaa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:43.734438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 598/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:43 2022] GET /identity/v3/projects/e1e42d50b50442e5bce02f3e8af543af => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:43.740652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc90e8-7f54-4589-9d88-5977923802b2 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:43.806200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:43.838512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc90e8-7f54-4589-9d88-5977923802b2 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:43.873025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b3306-edce-4ea3-8ec4-18d5c627ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:43.873664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b3306-edce-4ea3-8ec4-18d5c627ed0f None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:43.873941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b3306-edce-4ea3-8ec4-18d5c627ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:43.874243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b3306-edce-4ea3-8ec4-18d5c627ed0f None admin] PATH_INFO: `/v3/projects/e1e42d50b50442e5bce02f3e8af543af/users/6b6c0028addd47a6b677353b9536998e/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:43.876108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b3306-edce-4ea3-8ec4-18d5c627ed0f None admin] RBAC: Authorizing `identity:create_grant(project_id=e1e42d50b50442e5bce02f3e8af543af, user_id=6b6c0028addd47a6b677353b9536998e, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:43.877531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b3306-edce-4ea3-8ec4-18d5c627ed0f None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:43.890080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 594/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:17:43 2022] PUT /identity/v3/projects/e1e42d50b50442e5bce02f3e8af543af/users/6b6c0028addd47a6b677353b9536998e/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:17:45.844573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc87902-a67a-4874-889a-5f402332cf9b None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:45.845100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc87902-a67a-4874-889a-5f402332cf9b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:45.845100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc87902-a67a-4874-889a-5f402332cf9b None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:45.846506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 599/1193] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:17:45.851533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aee3a-2b9a-4e53-8c47-84c4d08962e6 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:45.851927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aee3a-2b9a-4e53-8c47-84c4d08962e6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:45.852108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aee3a-2b9a-4e53-8c47-84c4d08962e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:45.869689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f10aee3a-2b9a-4e53-8c47-84c4d08962e6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:17:45.870900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f10aee3a-2b9a-4e53-8c47-84c4d08962e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:17:45.935491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 595/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:17:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:17:45.958425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc87902-a67a-4874-889a-5f402332cf9b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:46.047908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:46.061323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc87902-a67a-4874-889a-5f402332cf9b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:46.094964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32322-a1b4-4cfc-b203-3c5454d8082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:46.095519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32322-a1b4-4cfc-b203-3c5454d8082a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:46.095798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32322-a1b4-4cfc-b203-3c5454d8082a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:46.096069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32322-a1b4-4cfc-b203-3c5454d8082a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:46.105788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c32322-a1b4-4cfc-b203-3c5454d8082a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-53c32322-a1b4-4cfc-b203-3c5454d8082a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:17:46.110421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:17:46.111496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:17:46.112537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 600/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:17:46.117888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10aee3a-2b9a-4e53-8c47-84c4d08962e6 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:46.174072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:46.215482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10aee3a-2b9a-4e53-8c47-84c4d08962e6 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:46.248309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:46.248890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:46.249167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:46.249437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:46.250105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:46.250409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:46.251795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:46.259513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 596/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:17:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:46.265765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32322-a1b4-4cfc-b203-3c5454d8082a None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:46.362351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32322-a1b4-4cfc-b203-3c5454d8082a None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:46.395702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed946b-4e77-443e-b821-0284fcc13ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:46.396311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed946b-4e77-443e-b821-0284fcc13ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:46.396590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed946b-4e77-443e-b821-0284fcc13ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:46.396861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed946b-4e77-443e-b821-0284fcc13ca4 None admin] PATH_INFO: `/v3/users/6b6c0028addd47a6b677353b9536998e` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:46.398029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed946b-4e77-443e-b821-0284fcc13ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=6b6c0028addd47a6b677353b9536998e)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:46.399475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed946b-4e77-443e-b821-0284fcc13ca4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:46.401036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 601/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Aug 8 00:17:46 2022] GET /identity/v3/users/6b6c0028addd47a6b677353b9536998e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:46.406951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:46.505516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4459a00-1e91-4db8-82ef-4ad07f74e44a None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:46.524487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:46.538417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efca3-2365-4e91-b8ba-1cfb073721ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:46.539006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efca3-2365-4e91-b8ba-1cfb073721ed None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:46.539290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efca3-2365-4e91-b8ba-1cfb073721ed None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:46.539566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efca3-2365-4e91-b8ba-1cfb073721ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:46.604037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4efca3-2365-4e91-b8ba-1cfb073721ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:46.605479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4efca3-2365-4e91-b8ba-1cfb073721ed None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:46.705466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 597/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:17:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:17:46.711447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed946b-4e77-443e-b821-0284fcc13ca4 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:46.728954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:46.807676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed946b-4e77-443e-b821-0284fcc13ca4 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:46.840884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba61f0-c029-4e2d-90f7-bd4858a35d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:46.841500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba61f0-c029-4e2d-90f7-bd4858a35d6d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:46.841779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba61f0-c029-4e2d-90f7-bd4858a35d6d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:46.842050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba61f0-c029-4e2d-90f7-bd4858a35d6d None admin] PATH_INFO: `/v3/projects/e1e42d50b50442e5bce02f3e8af543af` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:46.843169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba61f0-c029-4e2d-90f7-bd4858a35d6d None admin] RBAC: Authorizing `identity:get_project(project_id=e1e42d50b50442e5bce02f3e8af543af)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:46.844591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba61f0-c029-4e2d-90f7-bd4858a35d6d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:46.846276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 602/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Aug 8 00:17:46 2022] GET /identity/v3/projects/e1e42d50b50442e5bce02f3e8af543af => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:46.852362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efca3-2365-4e91-b8ba-1cfb073721ed None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:17:46.874126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:46.950122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efca3-2365-4e91-b8ba-1cfb073721ed None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:17:46.990906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482623aa-7c1b-4f2d-876b-aca62518c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:17:46.991503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482623aa-7c1b-4f2d-876b-aca62518c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:17:46.991785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482623aa-7c1b-4f2d-876b-aca62518c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:17:46.992058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482623aa-7c1b-4f2d-876b-aca62518c3d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:17:46.992768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482623aa-7c1b-4f2d-876b-aca62518c3d8 None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=e1e42d50b50442e5bce02f3e8af543af, user.id=6b6c0028addd47a6b677353b9536998e) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:17:46.993075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482623aa-7c1b-4f2d-876b-aca62518c3d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:17:46.994538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482623aa-7c1b-4f2d-876b-aca62518c3d8 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:17:47.000137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 598/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:17:46 2022] GET /identity/v3/role_assignments?user.id=6b6c0028addd47a6b677353b9536998e&scope.project.id=e1e42d50b50442e5bce02f3e8af543af&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:17:56.836835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=58 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:17:56.997559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=58 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:42.444145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16330c-84d4-45e9-9ea1-7e56d3eeca74 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:42.444775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16330c-84d4-45e9-9ea1-7e56d3eeca74 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:42.444775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16330c-84d4-45e9-9ea1-7e56d3eeca74 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:42.446048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 603/1201] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:18:42.451497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5eb37-83a8-4e7f-8b3c-67181a8ba68e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:42.452354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5eb37-83a8-4e7f-8b3c-67181a8ba68e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:42.452946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5eb37-83a8-4e7f-8b3c-67181a8ba68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:42.472093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-bbd5eb37-83a8-4e7f-8b3c-67181a8ba68e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:18:42.473463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-bbd5eb37-83a8-4e7f-8b3c-67181a8ba68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:18:42.572063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 599/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:18:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:18:42.596443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16330c-84d4-45e9-9ea1-7e56d3eeca74 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:42.736949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16330c-84d4-45e9-9ea1-7e56d3eeca74 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:42.786008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:42.786796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:42.787254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:42.787538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:42.800541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:42.802339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:18:42.823260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:42.824516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:18:42.825844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:18:42.825844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:42.825844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:18:42.825844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 604/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:42.831475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5eb37-83a8-4e7f-8b3c-67181a8ba68e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:42.961603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5eb37-83a8-4e7f-8b3c-67181a8ba68e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:42.998778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:43.005993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6676eba-55c5-4ff9-b21e-d3693f55df27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:43.006663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676eba-55c5-4ff9-b21e-d3693f55df27 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:43.007339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676eba-55c5-4ff9-b21e-d3693f55df27 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:43.007619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676eba-55c5-4ff9-b21e-d3693f55df27 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:43.008321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6676eba-55c5-4ff9-b21e-d3693f55df27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:43.008628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6676eba-55c5-4ff9-b21e-d3693f55df27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:43.010572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6676eba-55c5-4ff9-b21e-d3693f55df27 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:43.024700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 600/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:43.032889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:43.102002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:43.162712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017db809-380e-4c25-8696-c7fe001daeb4 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:43.209170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8b0dc-091d-4552-99f9-44591caa9948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:43.209777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8b0dc-091d-4552-99f9-44591caa9948 None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:43.210110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8b0dc-091d-4552-99f9-44591caa9948 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:43.210376 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8b0dc-091d-4552-99f9-44591caa9948 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:43.211022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8b0dc-091d-4552-99f9-44591caa9948 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:43.212439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8b0dc-091d-4552-99f9-44591caa9948 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:43.240809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 605/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Aug 8 00:18:43 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:18:45.409643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffbb39-e7ec-46e8-aea5-4a5251ed669c None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:45.410204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffbb39-e7ec-46e8-aea5-4a5251ed669c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:45.410204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffbb39-e7ec-46e8-aea5-4a5251ed669c None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:45.415263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 601/1206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:18:45.417539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606eedd-48f1-43f5-ad2d-faa8a761208b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:45.417964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606eedd-48f1-43f5-ad2d-faa8a761208b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:45.418165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606eedd-48f1-43f5-ad2d-faa8a761208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:45.437040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9606eedd-48f1-43f5-ad2d-faa8a761208b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:18:45.438491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9606eedd-48f1-43f5-ad2d-faa8a761208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:18:45.519910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 606/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:18:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:18:45.545891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffbb39-e7ec-46e8-aea5-4a5251ed669c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:45.657087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffbb39-e7ec-46e8-aea5-4a5251ed669c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:45.702331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67d2c6-0b01-4bfb-8a79-73256a2430f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:45.702331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67d2c6-0b01-4bfb-8a79-73256a2430f4 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:45.702331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67d2c6-0b01-4bfb-8a79-73256a2430f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:45.702331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67d2c6-0b01-4bfb-8a79-73256a2430f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:45.712421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67d2c6-0b01-4bfb-8a79-73256a2430f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-df67d2c6-0b01-4bfb-8a79-73256a2430f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:18:45.717778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:45.718873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:18:45.719733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:45.722237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 602/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:18:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:45.724963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606eedd-48f1-43f5-ad2d-faa8a761208b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:45.766760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:45.838613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606eedd-48f1-43f5-ad2d-faa8a761208b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:45.890959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:45.891886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:45.892172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:45.892447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:45.893170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:45.893482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:45.894923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:45.912414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 607/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:45.913706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67d2c6-0b01-4bfb-8a79-73256a2430f4 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:45.995270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:46.052295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67d2c6-0b01-4bfb-8a79-73256a2430f4 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:46.093458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:46.094404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:46.094695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:46.095059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:46.105918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:46.108100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:18:46.125718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:46.126785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:18:46.127720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:18:46.127720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:46.127720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:46.127720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 603/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:46.132925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:46.256947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366bb0c-0355-43b5-85ac-07c3b8e1a590 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:46.260538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:46.302365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:46.303104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:46.303459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:46.303796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:46.304579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:46.304983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:46.307218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:46.321883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 608/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:46.328205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:46.444421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5504e-a3a3-4090-bd3c-d7973242ae1e None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:46.445988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:46.480989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:46.481570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:46.481848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:46.482160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:46.490051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:46.492301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:18:46.507617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:46.509207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:18:46.510519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:46.515815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 604/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:46.517413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:46.636342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda635f4-f882-48da-b08d-44a10816ae12 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:46.677251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:46.677906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:46.678214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:46.678443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:46.679161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:46.679465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:46.680957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:46.703435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 609/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 00:18:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:46.710498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:46.835004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85dbf0-8544-40c9-8934-8ef59bacd016 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:46.876674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304db9df-45ed-4666-a030-94cd7fe02c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:46.877451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304db9df-45ed-4666-a030-94cd7fe02c92 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:46.877831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304db9df-45ed-4666-a030-94cd7fe02c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:46.878197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304db9df-45ed-4666-a030-94cd7fe02c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:46.922375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:46.966098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304db9df-45ed-4666-a030-94cd7fe02c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:46.967630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304db9df-45ed-4666-a030-94cd7fe02c92 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:47.086836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 605/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:18:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:18:47.092854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:47.113738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:47.208084 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a680-3a45-4edd-8a11-841a26010313 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:47.248230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:47.248885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:47.249167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:47.249441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:47.260287 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:47.261869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:18:47.276987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:47.278016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:18:47.279470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:18:47.279470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:47.279470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:18:47.279470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 610/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:47.284411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304db9df-45ed-4666-a030-94cd7fe02c92 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:47.357540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:47.403081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304db9df-45ed-4666-a030-94cd7fe02c92 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:47.444649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:47.445298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:47.445520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:47.445793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:47.446479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:47.446785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:47.448254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:47.466991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 606/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:18:47.467180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:47.544989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:47.580509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad80d9-ae3f-4201-809d-4befad56c7aa None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:47.620292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:47.620861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:47.621126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:47.621396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:47.628381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:47.629820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:18:47.641171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:47.642371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:18:47.643338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 611/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:47.648422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:47.761346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be105b93-c2ce-4d45-b823-fed1479a7f2c None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:47.787974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:47.805176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff7a6-fc4c-4665-bf00-df23f5ff4b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:47.805835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff7a6-fc4c-4665-bf00-df23f5ff4b24 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:47.806168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff7a6-fc4c-4665-bf00-df23f5ff4b24 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:47.806458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff7a6-fc4c-4665-bf00-df23f5ff4b24 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:47.807193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff7a6-fc4c-4665-bf00-df23f5ff4b24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:47.807536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff7a6-fc4c-4665-bf00-df23f5ff4b24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:47.809004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff7a6-fc4c-4665-bf00-df23f5ff4b24 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:47.827503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 607/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:47.828786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:47.945827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ca14-c44e-4256-9366-138a9aeb3f9b None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:47.977776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:47.986854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1238d-14c9-4ea0-bd0c-1ae20a30d2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:47.987524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1238d-14c9-4ea0-bd0c-1ae20a30d2a3 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:47.987938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1238d-14c9-4ea0-bd0c-1ae20a30d2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:47.988267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1238d-14c9-4ea0-bd0c-1ae20a30d2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:47.988997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1238d-14c9-4ea0-bd0c-1ae20a30d2a3 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=a35c6a59728d4b3c9fad8599c88f779e) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:47.989338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1238d-14c9-4ea0-bd0c-1ae20a30d2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:47.990804 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1238d-14c9-4ea0-bd0c-1ae20a30d2a3 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:47.997848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 612/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:18:47 2022] GET /identity/v3/role_assignments?user.id=a35c6a59728d4b3c9fad8599c88f779e&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:50.170400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e083f9-af34-481b-9df8-cab8e79d43c3 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:50.171092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e083f9-af34-481b-9df8-cab8e79d43c3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:50.171092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e083f9-af34-481b-9df8-cab8e79d43c3 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:50.172717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 608/1220] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:18:50.179607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119918-7dcb-45e1-ae44-7e7f1008e606 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:50.180040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119918-7dcb-45e1-ae44-7e7f1008e606 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:50.180163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119918-7dcb-45e1-ae44-7e7f1008e606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:50.201165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-29119918-7dcb-45e1-ae44-7e7f1008e606 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:18:50.202616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-29119918-7dcb-45e1-ae44-7e7f1008e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:18:50.276063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 613/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:18:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:18:50.300041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e083f9-af34-481b-9df8-cab8e79d43c3 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:50.411544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e083f9-af34-481b-9df8-cab8e79d43c3 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:50.452096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146c06-64ad-4759-9dde-0a7b9d09f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:50.452763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146c06-64ad-4759-9dde-0a7b9d09f159 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:50.453061 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146c06-64ad-4759-9dde-0a7b9d09f159 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:50.453361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146c06-64ad-4759-9dde-0a7b9d09f159 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:50.465561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146c06-64ad-4759-9dde-0a7b9d09f159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-3f146c06-64ad-4759-9dde-0a7b9d09f159 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:18:50.470646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:50.471798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:50.472796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 609/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:18:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:50.478976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29119918-7dcb-45e1-ae44-7e7f1008e606 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:50.587616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29119918-7dcb-45e1-ae44-7e7f1008e606 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:50.616685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:50.627907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:50.628510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:50.628791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:50.629064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:50.629739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] RBAC: Adding query filter params (name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:50.630027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:50.631528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:50.639849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 614/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:18:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:18:50.647130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146c06-64ad-4759-9dde-0a7b9d09f159 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:50.704208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:50.767230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146c06-64ad-4759-9dde-0a7b9d09f159 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:50.806348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:50.806996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:50.807277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:50.807551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:50.818285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:50.819920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:18:50.836625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:50.837620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:18:50.839625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:18:50.839625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:50.839625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:50.839625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 610/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:50.844561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:50.956330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ae16d-4473-4cbb-b070-66db27d94b45 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:50.992054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:50.992653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:50.992935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:50.993206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:50.993834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:50.994165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:50.995519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:51.007818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 615/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:51.015260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:51.122566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:51.130266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc74a4-b023-459c-825e-f8c473683b19 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:51.168491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:51.169153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:51.169473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:51.169771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] PATH_INFO: `/v3/users/placement` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:51.177626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:51.179106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:18:51.190017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:51.191142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:51.192268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 611/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:18:51.196975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:51.249057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:51.302932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6d516-1c82-46e0-b642-bbabf39fcfc6 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:51.338331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:51.338958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:51.339242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:51.339518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:51.340238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:51.340544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:51.341963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:51.358910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 616/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 00:18:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:51.364550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:51.477667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b037-0de9-4e61-9153-b96443839cde None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:51.523184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:51.523771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:51.524068 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:51.524339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:51.535881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:51.537348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:18:51.551156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:51.553997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:18:51.554959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:18:51.554959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:51.554959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:51.554959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 612/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:51.558635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:51.671528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d507f-ea4d-4f5a-acba-c72800a5cb9c None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:51.674162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:51.711266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:51.712076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:51.712484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:51.712997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:51.713859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:51.714201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:51.715970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:51.730775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 617/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:51.737294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:51.748241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:51.856980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151980de-17b4-44c8-9705-d1643d914051 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:51.895187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:51.895812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:51.896093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:51.896359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:51.903424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:51.904863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:18:51.917272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:51.918344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:51.919445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 613/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:51.925411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:52.034659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a415c-39f6-49b9-95b8-0b3643e3da6e None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:52.075183 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300228cf-f9f0-4641-885e-83e41344a88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:52.075874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300228cf-f9f0-4641-885e-83e41344a88a None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:52.076137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300228cf-f9f0-4641-885e-83e41344a88a None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:52.076445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300228cf-f9f0-4641-885e-83e41344a88a None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:52.077175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300228cf-f9f0-4641-885e-83e41344a88a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:52.077493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300228cf-f9f0-4641-885e-83e41344a88a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:52.079052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300228cf-f9f0-4641-885e-83e41344a88a None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:52.092601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 618/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:52.099039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:52.177099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:52.215257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f609dc3-2aa5-49af-a43f-119ce2f45f21 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:52.258719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2832fd-d26d-4f81-89ce-e8c979d0c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:52.259375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2832fd-d26d-4f81-89ce-e8c979d0c9fe None admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:52.259649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2832fd-d26d-4f81-89ce-e8c979d0c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:52.259932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2832fd-d26d-4f81-89ce-e8c979d0c9fe None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/a35c6a59728d4b3c9fad8599c88f779e/roles/db558e2340b04e8194fea3fe2b17b159` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:52.277300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2832fd-d26d-4f81-89ce-e8c979d0c9fe None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=a35c6a59728d4b3c9fad8599c88f779e, role_id=db558e2340b04e8194fea3fe2b17b159)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:52.278877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2832fd-d26d-4f81-89ce-e8c979d0c9fe None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:52.292569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 614/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:18:52 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/a35c6a59728d4b3c9fad8599c88f779e/roles/db558e2340b04e8194fea3fe2b17b159 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:18:54.415411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f0bb-2325-4d44-a3b1-631a889d2106 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:54.416512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f0bb-2325-4d44-a3b1-631a889d2106 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:54.416512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f0bb-2325-4d44-a3b1-631a889d2106 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:54.417840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 619/1233] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:18:54.423220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32cdb1-374b-4958-bbf5-ba58348e1ba4 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:54.423649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32cdb1-374b-4958-bbf5-ba58348e1ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:54.423769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32cdb1-374b-4958-bbf5-ba58348e1ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:54.441117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-ed32cdb1-374b-4958-bbf5-ba58348e1ba4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:18:54.442343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ed32cdb1-374b-4958-bbf5-ba58348e1ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:18:54.519158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 615/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:18:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:18:54.547894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3f0bb-2325-4d44-a3b1-631a889d2106 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:54.575792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:54.659671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3f0bb-2325-4d44-a3b1-631a889d2106 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:54.698307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8eb2d-cea1-4802-9474-1a51bf4bdaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:54.698856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8eb2d-cea1-4802-9474-1a51bf4bdaa0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:54.699130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8eb2d-cea1-4802-9474-1a51bf4bdaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:54.699636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8eb2d-cea1-4802-9474-1a51bf4bdaa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:54.713051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8eb2d-cea1-4802-9474-1a51bf4bdaa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-6bf8eb2d-cea1-4802-9474-1a51bf4bdaa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:18:54.718667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:54.719746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:18:54.720649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 620/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Aug 8 00:18:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:54.727117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32cdb1-374b-4958-bbf5-ba58348e1ba4 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:54.779429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:54.833382 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32cdb1-374b-4958-bbf5-ba58348e1ba4 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:54.876819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:54.877732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:54.878055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:54.878552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:54.879477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] RBAC: Adding query filter params (name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:54.879818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:54.881807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:54.894054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 616/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Aug 8 00:18:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:54.899981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8eb2d-cea1-4802-9474-1a51bf4bdaa0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:54.995779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:55.016520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8eb2d-cea1-4802-9474-1a51bf4bdaa0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:55.053958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:55.054718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:55.055107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:55.055410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:55.066227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:55.067888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:18:55.084148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:55.085321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:18:55.086336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:18:55.086336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:55.086336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:18:55.086336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 621/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:55.092583 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:55.231929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a97ec-9633-43ce-a4fb-41ec464fe1fd None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:55.241431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:55.272575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:55.273111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:55.273392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:55.273666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:55.274630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:55.275092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:55.276477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:55.291162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 617/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:55.297924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:55.410705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e000-59af-4437-8922-5cb72ba475e0 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:55.450604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:55.451550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:55.451834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:55.452107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:55.455017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:55.461230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:55.462790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:18:55.475042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:55.476261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:18:55.477386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 622/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:18:55.482985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:55.589103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb206a-4d6f-4fe5-87a9-dd534ee054cb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:55.637325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:55.637943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:55.638263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:55.638538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:55.639371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:55.639759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:55.641665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:55.662010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 618/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 00:18:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:18:55.668598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:55.783801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067ded-1bc8-43c3-8d5d-12a88e3f25ff None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:55.823003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13da5b-319e-42e0-8ac1-45ad5a8e2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:55.823781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13da5b-319e-42e0-8ac1-45ad5a8e2c97 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:55.824066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13da5b-319e-42e0-8ac1-45ad5a8e2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:55.824337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13da5b-319e-42e0-8ac1-45ad5a8e2c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:55.894780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:55.903743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13da5b-319e-42e0-8ac1-45ad5a8e2c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:55.905410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13da5b-319e-42e0-8ac1-45ad5a8e2c97 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:56.021995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 623/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:18:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:18:56.028924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:56.061797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:56.143917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e583ca-8026-4abf-9e98-06b889a7abaf None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:56.185221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:56.185997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:56.186452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:56.186561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:56.198489 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:56.200109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:18:56.217847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:56.218916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:18:56.219891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:18:56.219891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:56.219891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:56.219891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 619/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:18:56.225914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13da5b-319e-42e0-8ac1-45ad5a8e2c97 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:56.325779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:56.333160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13da5b-319e-42e0-8ac1-45ad5a8e2c97 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:56.369989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:56.370659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:56.370945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:56.371217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:56.371850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:56.372152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:56.373866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:56.391964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 624/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:56.393307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:56.480235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:56.504957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e582deb-2655-4e93-bc60-e33cc17e1803 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:56.545911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:56.546693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:56.547006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:56.547282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:56.554250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:56.555723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:18:56.568036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:56.569134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:18:56.570046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 620/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:56.575536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:56.686479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26395629-dccc-4eb0-ae33-ae8ca9742292 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:56.725225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb74fb-38fe-44bb-9dda-ca803a2a0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:56.725837 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb74fb-38fe-44bb-9dda-ca803a2a0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:56.726143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb74fb-38fe-44bb-9dda-ca803a2a0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:56.726417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb74fb-38fe-44bb-9dda-ca803a2a0bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:56.727103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb74fb-38fe-44bb-9dda-ca803a2a0bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:56.727411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb74fb-38fe-44bb-9dda-ca803a2a0bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:56.729479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb74fb-38fe-44bb-9dda-ca803a2a0bc8 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:56.744101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 625/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:56.750484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:56.859221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d8250-edb0-40bf-a5dc-b83590cf3638 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:56.894034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfa9dd-1add-49c1-a049-8efb115f30f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:56.894666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfa9dd-1add-49c1-a049-8efb115f30f0 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:56.894948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfa9dd-1add-49c1-a049-8efb115f30f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:56.895222 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfa9dd-1add-49c1-a049-8efb115f30f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:56.895944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfa9dd-1add-49c1-a049-8efb115f30f0 None admin] RBAC: Adding query filter params (role.id=db558e2340b04e8194fea3fe2b17b159, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=a35c6a59728d4b3c9fad8599c88f779e) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:56.896253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfa9dd-1add-49c1-a049-8efb115f30f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:56.897674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfa9dd-1add-49c1-a049-8efb115f30f0 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:56.909396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 621/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:18:56 2022] GET /identity/v3/role_assignments?user.id=a35c6a59728d4b3c9fad8599c88f779e&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=db558e2340b04e8194fea3fe2b17b159 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:18:59.042157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de0dd-f0b3-4609-8512-e49f36060f8d None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:59.042903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de0dd-f0b3-4609-8512-e49f36060f8d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:59.042903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de0dd-f0b3-4609-8512-e49f36060f8d None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:59.044028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 626/1247] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:18:59.049674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62d879-f817-4f42-8e6c-dc3737ca1cec None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:59.050133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62d879-f817-4f42-8e6c-dc3737ca1cec None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:59.050463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62d879-f817-4f42-8e6c-dc3737ca1cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:59.059012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:59.073419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-dc62d879-f817-4f42-8e6c-dc3737ca1cec None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:18:59.074659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dc62d879-f817-4f42-8e6c-dc3737ca1cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:18:59.147002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 622/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:18:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:18:59.170131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de0dd-f0b3-4609-8512-e49f36060f8d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:59.189184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:59.298520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de0dd-f0b3-4609-8512-e49f36060f8d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:59.337008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93254e73-4500-4b77-b3c6-bf21b7e58bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:59.337008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93254e73-4500-4b77-b3c6-bf21b7e58bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:59.337008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93254e73-4500-4b77-b3c6-bf21b7e58bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:59.337008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93254e73-4500-4b77-b3c6-bf21b7e58bc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:59.348331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93254e73-4500-4b77-b3c6-bf21b7e58bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-93254e73-4500-4b77-b3c6-bf21b7e58bc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:18:59.353991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:59.355435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:18:59.356679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 627/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:18:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:59.361311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62d879-f817-4f42-8e6c-dc3737ca1cec None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:59.473312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62d879-f817-4f42-8e6c-dc3737ca1cec None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:59.507852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:59.515236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:59.516507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:59.517171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:59.517471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:59.518385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:59.518825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:59.520663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:59.533224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 623/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:18:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:59.539548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93254e73-4500-4b77-b3c6-bf21b7e58bc2 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:59.634047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:18:59.661288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93254e73-4500-4b77-b3c6-bf21b7e58bc2 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:59.699347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:59.700377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:59.700672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:59.700966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:59.716269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:59.717784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:18:59.734402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:18:59.735626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:18:59.736656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:18:59.736656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:18:59.736656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:18:59.736656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 628/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:18:59.742601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:18:59.853593 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcd597-3741-4448-a497-9a603c1800cf None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:18:59.891992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:18:59.892566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:18:59.892846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:18:59.893208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:18:59.893761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:18:59.894092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:18:59.895477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:18:59.909688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 624/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:18:59.916542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:00.035377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043c48-badf-4cac-aaa6-e4450dd3ab58 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:00.064588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:00.075177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:00.075827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:00.076126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:00.076383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:00.084799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:00.085884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:19:00.098611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:00.101432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:19:00.102568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 629/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:18:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:00.108811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:00.180875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:00.234898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a979ed0-1ba7-4ecf-83f2-7d2bd7969e56 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:00.276138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:00.276734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:00.277016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:00.277284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:00.278006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:00.278414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:00.279865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:00.297586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 625/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 00:19:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:00.303437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:00.420032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5052b0-19bb-4b40-b3ea-20b9d10957bd None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:00.463298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dda50-d8f5-478d-96aa-50b8dcd412fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:00.464032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dda50-d8f5-478d-96aa-50b8dcd412fb None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:00.464317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dda50-d8f5-478d-96aa-50b8dcd412fb None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:00.464590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dda50-d8f5-478d-96aa-50b8dcd412fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:00.554496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:00.570867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dda50-d8f5-478d-96aa-50b8dcd412fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:00.573115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dda50-d8f5-478d-96aa-50b8dcd412fb None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:00.688052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 630/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:19:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:19:00.693928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:00.814285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb746ab-a3ea-467e-afaa-c039bc40b434 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:00.828506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:00.861974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:00.862653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:00.862931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:00.863219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:00.873763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:00.875348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:19:00.889220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:00.890265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:19:00.891456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:19:00.891456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:00.891456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:00.891456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 626/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:00.896458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dda50-d8f5-478d-96aa-50b8dcd412fb None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:00.988121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:01.002350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dda50-d8f5-478d-96aa-50b8dcd412fb None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:01.045279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:01.045892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:01.046208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:01.046579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:01.047279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:01.047703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:01.049379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:01.066188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 631/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:19:01.070711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:01.183790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16192f27-a9e7-4145-bfdc-42a78bd0ecbc None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:01.224480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:01.225148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:01.225431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:01.225704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:01.232940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:01.234417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:19:01.246033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:01.247228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:01.248136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 627/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:01.253296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:01.362028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3e830-31c4-4825-9bf7-99f145fc3746 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:01.397910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ca517-b75d-4045-85e9-dd52c3954a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:01.398533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca517-b75d-4045-85e9-dd52c3954a1f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:01.398817 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca517-b75d-4045-85e9-dd52c3954a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:01.399077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca517-b75d-4045-85e9-dd52c3954a1f None admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:01.400249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ca517-b75d-4045-85e9-dd52c3954a1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:01.400554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ca517-b75d-4045-85e9-dd52c3954a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:01.402109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ca517-b75d-4045-85e9-dd52c3954a1f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:01.414859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 632/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:01.421750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:01.449493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:01.540521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c10f-e752-4afe-9f1f-027c2e43de93 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:01.583637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50f96a-54a5-4bc6-89ae-c0526656878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:01.584380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f96a-54a5-4bc6-89ae-c0526656878a None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:01.584761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f96a-54a5-4bc6-89ae-c0526656878a None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:01.585138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f96a-54a5-4bc6-89ae-c0526656878a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:01.585973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50f96a-54a5-4bc6-89ae-c0526656878a None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=a35c6a59728d4b3c9fad8599c88f779e) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:01.586380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50f96a-54a5-4bc6-89ae-c0526656878a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:01.588757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50f96a-54a5-4bc6-89ae-c0526656878a None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:01.595882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 628/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:19:01 2022] GET /identity/v3/role_assignments?user.id=a35c6a59728d4b3c9fad8599c88f779e&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:03.643074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a6263-3ec7-456c-9a46-b5d84e08611c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:03.643639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a6263-3ec7-456c-9a46-b5d84e08611c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:03.643639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a6263-3ec7-456c-9a46-b5d84e08611c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:03.644954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 633/1261] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:19:03.650256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79109b-9095-4a26-9517-c6e779a82aa5 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:03.650671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79109b-9095-4a26-9517-c6e779a82aa5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:03.650852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79109b-9095-4a26-9517-c6e779a82aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:03.668788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-dc79109b-9095-4a26-9517-c6e779a82aa5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:19:03.670874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dc79109b-9095-4a26-9517-c6e779a82aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:19:03.736459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 629/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:19:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:19:03.760518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a6263-3ec7-456c-9a46-b5d84e08611c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:03.771908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:03.863525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a6263-3ec7-456c-9a46-b5d84e08611c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:03.898390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053144be-107b-457b-af82-2e773abef767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:03.898933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053144be-107b-457b-af82-2e773abef767 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:03.899212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053144be-107b-457b-af82-2e773abef767 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:03.899491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053144be-107b-457b-af82-2e773abef767 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:03.909861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053144be-107b-457b-af82-2e773abef767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-053144be-107b-457b-af82-2e773abef767 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:19:03.914467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:03.916277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:19:03.917385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 634/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:03.922251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79109b-9095-4a26-9517-c6e779a82aa5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:03.941224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:04.022110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79109b-9095-4a26-9517-c6e779a82aa5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:04.054749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:04.055353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:04.055649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:04.056896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:04.058608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:04.058935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:04.060339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:04.074013 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 630/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:04.080293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053144be-107b-457b-af82-2e773abef767 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:04.151323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:04.183989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053144be-107b-457b-af82-2e773abef767 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:04.216373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:04.216987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:04.217260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:04.217528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:04.227110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:04.229139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:19:04.242916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:04.244025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:19:04.245134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:19:04.245134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:04.245134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:19:04.245134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 635/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 00:19:04.249773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:04.329551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:04.347877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19161de0-de47-4a39-bdba-cf6c97c15c38 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:04.391713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:04.393028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:04.393320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:04.393596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:04.394265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:04.394571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:04.398027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:04.412225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 631/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:04.417952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:04.517575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d13cb7-54ab-40d8-9b07-ea2031dc6765 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:04.537913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:04.555410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:04.556862 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:04.557252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:04.557624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:04.567328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:04.568767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:19:04.579830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:04.580902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:19:04.582045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 636/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:19:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:04.586885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:04.685741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ae5d-ea6e-419d-a660-6266e8bd212d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:04.725804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:04.726719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:04.727144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:04.727550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:04.729186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:04.729657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:04.731981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:04.745285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:04.753932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 632/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 00:19:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:04.759724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:04.857677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dbfa1-8ed2-46ae-ac0f-ef6058310de2 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:04.889886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:04.890527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:04.890808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:04.891327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:04.902040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:04.903512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:19:04.917497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:04.918680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:19:04.919740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:19:04.919740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:04.919740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:19:04.919740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 637/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:04.924246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:05.030658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ac19-5b35-4531-9010-460cca95d895 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:05.073457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:05.074058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:05.074373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:05.074648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:05.075291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:05.075596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:05.076978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:05.088466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 633/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:05.094086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:05.124924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:05.191502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a2f99-8e42-4775-932c-82907ff521ec None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:05.223719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:05.224326 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:05.224608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:05.224885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:05.232479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:05.233901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:19:05.244800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:05.245842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:19:05.246802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 638/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:05.251533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:05.308470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:05.349589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18610f6-8b72-4c5c-86b7-b946fbf1803d None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:05.381149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3896f85-fa57-4272-930d-b6d305ae484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:05.381733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3896f85-fa57-4272-930d-b6d305ae484c None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:05.382010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3896f85-fa57-4272-930d-b6d305ae484c None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:05.382306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3896f85-fa57-4272-930d-b6d305ae484c None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:05.382979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3896f85-fa57-4272-930d-b6d305ae484c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:05.383280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3896f85-fa57-4272-930d-b6d305ae484c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:05.385177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3896f85-fa57-4272-930d-b6d305ae484c None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:05.396783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 634/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:05.403198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:05.492332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:05.503163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f744d-d74c-4fba-9eb0-7be5e9348836 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:05.540261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd046-e441-478a-ab32-a8985f302ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:05.540908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd046-e441-478a-ab32-a8985f302ab4 None admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:05.541192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd046-e441-478a-ab32-a8985f302ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:05.541470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd046-e441-478a-ab32-a8985f302ab4 None admin] PATH_INFO: `/v3/projects/575eaa0faad84155959ef314d59f590c/users/a35c6a59728d4b3c9fad8599c88f779e/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:05.543403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddd046-e441-478a-ab32-a8985f302ab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=575eaa0faad84155959ef314d59f590c, user_id=a35c6a59728d4b3c9fad8599c88f779e, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:05.544826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddd046-e441-478a-ab32-a8985f302ab4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:05.557824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 639/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Aug 8 00:19:05 2022] PUT /identity/v3/projects/575eaa0faad84155959ef314d59f590c/users/a35c6a59728d4b3c9fad8599c88f779e/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:19:07.509677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956fc8-12bd-4cae-ae7a-c1998da2687f None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:07.510229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956fc8-12bd-4cae-ae7a-c1998da2687f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:07.510390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956fc8-12bd-4cae-ae7a-c1998da2687f None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:07.511588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 635/1274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:19:07.517114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a306c1-2ed3-42df-b3a8-2dffc3a0c1cc None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:07.517538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a306c1-2ed3-42df-b3a8-2dffc3a0c1cc None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:07.517791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a306c1-2ed3-42df-b3a8-2dffc3a0c1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:07.535458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c5a306c1-2ed3-42df-b3a8-2dffc3a0c1cc None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:19:07.536647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c5a306c1-2ed3-42df-b3a8-2dffc3a0c1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:19:07.600382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 640/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:19:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:19:07.624096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60956fc8-12bd-4cae-ae7a-c1998da2687f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:07.723979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60956fc8-12bd-4cae-ae7a-c1998da2687f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:07.740786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:07.757405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efa644-7a99-4496-bd36-b741b4cb019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:07.758013 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa644-7a99-4496-bd36-b741b4cb019b None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:07.758319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa644-7a99-4496-bd36-b741b4cb019b None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:07.758591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa644-7a99-4496-bd36-b741b4cb019b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:07.768575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efa644-7a99-4496-bd36-b741b4cb019b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-13efa644-7a99-4496-bd36-b741b4cb019b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 00:19:07.773084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:07.774201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:07.775185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 636/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Aug 8 00:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:07.780097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a306c1-2ed3-42df-b3a8-2dffc3a0c1cc None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:07.858863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:07.877994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a306c1-2ed3-42df-b3a8-2dffc3a0c1cc None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:07.911325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:07.911912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:07.912187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:07.912455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:07.913129 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:07.913426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:07.914793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:07.923302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 641/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Aug 8 00:19:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:07.928992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efa644-7a99-4496-bd36-b741b4cb019b None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:08.026997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efa644-7a99-4496-bd36-b741b4cb019b None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:08.059833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:08.060426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:08.060703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:08.060973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:08.070525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:08.071942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:19:08.085668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:08.086807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:19:08.088393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:19:08.088393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:08.088393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:08.088393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 637/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:08.092918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:08.195945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a5b6-5bef-4fb0-a78e-c4a0470526a9 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:08.228624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:08.229212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:08.229489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:08.229757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:08.230420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:08.230718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:08.232069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:08.243320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 642/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:08.249060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:08.279746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:08.345834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae71abc-bd60-4a07-abe2-3e13017199d6 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:08.377169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:08.377770 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:08.378048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:08.378348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:08.386572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:08.388002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 00:19:08.398724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:08.400312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:08.401277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 638/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:19:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:08.406116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:08.409760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:08.503958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafe8c5-c659-4051-b487-e11a91f2bed4 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:08.545604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:08.546420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:08.546622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:08.546931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:08.547713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:08.548053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:08.549667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:08.569372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 643/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Aug 8 00:19:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:08.576428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:08.664213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:08.674038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb63a2c-7983-4430-b09d-41728588a6a7 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:08.706827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7acfdc-12d3-4233-9ebb-97ef8bfeefc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:08.707408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7acfdc-12d3-4233-9ebb-97ef8bfeefc3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:08.707686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7acfdc-12d3-4233-9ebb-97ef8bfeefc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:08.707954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7acfdc-12d3-4233-9ebb-97ef8bfeefc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:08.772829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7acfdc-12d3-4233-9ebb-97ef8bfeefc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:08.774287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7acfdc-12d3-4233-9ebb-97ef8bfeefc3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:08.863999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:08.874972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 639/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Aug 8 00:19:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 00:19:08.880834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:08.940242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:08.976821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316455d4-2dfd-4760-88ab-bf798352b073 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:09.009856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:09.010495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:09.010775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:09.011050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:09.020951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:09.022396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 00:19:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:09.037349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 00:19:09.038439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 00:19:09.038439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 00:19:09.038439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:19:09.038439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 644/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:09.043521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7acfdc-12d3-4233-9ebb-97ef8bfeefc3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:09.137895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7acfdc-12d3-4233-9ebb-97ef8bfeefc3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:09.170453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:09.171034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:09.171311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:09.171579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:09.172202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:09.172503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:09.173852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:09.185289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 640/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Aug 8 00:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:09.190850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:09.286215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ecde5-92c1-463c-b236-e8dea21760db None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:09.299567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:09.319714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:09.320320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:09.320598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:09.320869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:09.327382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:09.328803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 00:19:09.340956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:09.342002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: ERROR keystone.server.flask.application Aug 08 00:19:09.343141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 645/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Aug 8 00:19:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:09.347733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:09.395919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:09.444501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeed559-4e4c-40df-b223-cf30c8b3a7e9 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:09.476918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652a7c2-a088-4782-8e4d-0da55fde8987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:09.477515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a7c2-a088-4782-8e4d-0da55fde8987 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:09.478401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a7c2-a088-4782-8e4d-0da55fde8987 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:09.478677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a7c2-a088-4782-8e4d-0da55fde8987 None admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:09.479360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652a7c2-a088-4782-8e4d-0da55fde8987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:09.479668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652a7c2-a088-4782-8e4d-0da55fde8987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:09.481085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652a7c2-a088-4782-8e4d-0da55fde8987 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:09.494968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 641/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Aug 8 00:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:09.501758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:09.599114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163bae0-26bd-4836-8143-330e4bb13547 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:09.631081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a96196-63fe-4ce1-886b-49d047a58f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:09.631661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96196-63fe-4ce1-886b-49d047a58f9f None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:09.631935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96196-63fe-4ce1-886b-49d047a58f9f None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:09.632200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96196-63fe-4ce1-886b-49d047a58f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:09.632899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a96196-63fe-4ce1-886b-49d047a58f9f None admin] RBAC: Adding query filter params (role.id=1ffa1545737240e1be8af23984ab85c1, scope.project.id=575eaa0faad84155959ef314d59f590c, user.id=a35c6a59728d4b3c9fad8599c88f779e) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:09.633200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a96196-63fe-4ce1-886b-49d047a58f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:09.634624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a96196-63fe-4ce1-886b-49d047a58f9f None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:09.640383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 646/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Aug 8 00:19:09 2022] GET /identity/v3/role_assignments?user.id=a35c6a59728d4b3c9fad8599c88f779e&scope.project.id=575eaa0faad84155959ef314d59f590c&role.id=1ffa1545737240e1be8af23984ab85c1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:19:11.670152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14c2ba-6731-416a-9b4c-42c45b197fa0 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:11.670808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14c2ba-6731-416a-9b4c-42c45b197fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:11.670808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14c2ba-6731-416a-9b4c-42c45b197fa0 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:11.672044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 642/1288] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:19:11.677044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7d3c-4399-4889-afde-6859707628ef None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:11.677476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7d3c-4399-4889-afde-6859707628ef None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:11.677607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7d3c-4399-4889-afde-6859707628ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:11.695300 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-abbc7d3c-4399-4889-afde-6859707628ef None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:19:11.696481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-abbc7d3c-4399-4889-afde-6859707628ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:19:11.725361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:11.762037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 647/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:19:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 00:19:11.784085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14c2ba-6731-416a-9b4c-42c45b197fa0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:11.883977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14c2ba-6731-416a-9b4c-42c45b197fa0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:11.895203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:11.919547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:11.920211 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:11.920448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:11.920724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:11.921304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:11.922692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:11.931124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:11.932360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:11.938269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 643/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:19:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:11.939325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7d3c-4399-4889-afde-6859707628ef None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:12.033757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7d3c-4399-4889-afde-6859707628ef None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:12.065635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc212c-de60-44e7-b7a2-c604942394b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:12.066248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc212c-de60-44e7-b7a2-c604942394b4 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:12.066529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc212c-de60-44e7-b7a2-c604942394b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:12.066798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc212c-de60-44e7-b7a2-c604942394b4 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:12.067418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc212c-de60-44e7-b7a2-c604942394b4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:12.067719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc212c-de60-44e7-b7a2-c604942394b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:12.069060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc212c-de60-44e7-b7a2-c604942394b4 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:12.074193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 648/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 8 00:19:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:12.079771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:12.178309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a55b3c-487a-4319-b820-f1919c81e1a3 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:12.210629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd0791-065a-4f99-a886-671c67de9626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:12.211214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0791-065a-4f99-a886-671c67de9626 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:12.211496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0791-065a-4f99-a886-671c67de9626 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:12.212369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0791-065a-4f99-a886-671c67de9626 None admin] PATH_INFO: `/v3/services` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:12.212999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd0791-065a-4f99-a886-671c67de9626 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:12.213298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd0791-065a-4f99-a886-671c67de9626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:12.214679 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd0791-065a-4f99-a886-671c67de9626 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:12.218932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 644/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 8 00:19:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:14.269949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c24f4-3fcf-4885-a084-7d97c1391da2 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:14.270535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c24f4-3fcf-4885-a084-7d97c1391da2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:14.270630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c24f4-3fcf-4885-a084-7d97c1391da2 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:14.271937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 649/1293] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:19:14.277018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0e5c-3131-4bdb-b288-5cf280e59b67 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:14.277446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0e5c-3131-4bdb-b288-5cf280e59b67 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:14.277552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0e5c-3131-4bdb-b288-5cf280e59b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:14.295470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-822f0e5c-3131-4bdb-b288-5cf280e59b67 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:19:14.296639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-822f0e5c-3131-4bdb-b288-5cf280e59b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:19:14.325717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:14.362147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 645/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:19:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:19:14.384821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c24f4-3fcf-4885-a084-7d97c1391da2 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:14.415650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:14.484814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c24f4-3fcf-4885-a084-7d97c1391da2 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:14.526618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae46115-432a-4661-a24f-4782ee806d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:14.527267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46115-432a-4661-a24f-4782ee806d2b None admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:14.527612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46115-432a-4661-a24f-4782ee806d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:14.527966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46115-432a-4661-a24f-4782ee806d2b None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:14.528823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae46115-432a-4661-a24f-4782ee806d2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:14.530491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae46115-432a-4661-a24f-4782ee806d2b None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:14.549667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 650/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Aug 8 00:19:14 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:19:16.563235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2683b-f361-4d11-83b8-de48a4057248 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:16.563788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2683b-f361-4d11-83b8-de48a4057248 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:16.563788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2683b-f361-4d11-83b8-de48a4057248 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:16.565121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 646/1296] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:19:16.570120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b82517-fcfe-4598-a7af-75f2f28a31e2 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:16.570541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b82517-fcfe-4598-a7af-75f2f28a31e2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:16.570648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b82517-fcfe-4598-a7af-75f2f28a31e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:16.589173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-38b82517-fcfe-4598-a7af-75f2f28a31e2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:19:16.590372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-38b82517-fcfe-4598-a7af-75f2f28a31e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:19:16.659949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 651/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:19:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:19:16.682372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2683b-f361-4d11-83b8-de48a4057248 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:16.781839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2683b-f361-4d11-83b8-de48a4057248 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:16.814278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:16.814827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:16.815109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:16.815380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:16.815953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:16.817389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:16.826697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:16.827823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:16.828951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 647/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:19:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:16.833650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b82517-fcfe-4598-a7af-75f2f28a31e2 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:16.851691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:16.931553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b82517-fcfe-4598-a7af-75f2f28a31e2 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:16.964874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:16.965460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:16.965737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:16.966003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:16.966640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:16.966935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:16.968266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:16.973176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 652/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 8 00:19:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:19:16.979270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:17.010391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:17.076067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167032f-0646-468a-954c-bd46469a83bb None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:17.107349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a856d1-b1ba-41e7-933e-ac461b161ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:17.107929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a856d1-b1ba-41e7-933e-ac461b161ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:17.108206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a856d1-b1ba-41e7-933e-ac461b161ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:17.108476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a856d1-b1ba-41e7-933e-ac461b161ff7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:17.109156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a856d1-b1ba-41e7-933e-ac461b161ff7 None admin] RBAC: Adding query filter params (interface=public, service_id=0fc95669d7bd4347b3035df929f58179, region_id=RegionOne) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:17.109459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a856d1-b1ba-41e7-933e-ac461b161ff7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:17.110833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a856d1-b1ba-41e7-933e-ac461b161ff7 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:17.115727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 648/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Aug 8 00:19:16 2022] GET /identity/v3/endpoints?service_id=0fc95669d7bd4347b3035df929f58179&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:17.121711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:17.199908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:17.217158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3380c-00e1-4c96-8443-85215e96aa90 None admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:17.249885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbb4ee-8e54-4e04-b057-082792ab425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:17.250494 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbb4ee-8e54-4e04-b057-082792ab425d None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:17.250772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbb4ee-8e54-4e04-b057-082792ab425d None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:17.251042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbb4ee-8e54-4e04-b057-082792ab425d None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:17.251623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbb4ee-8e54-4e04-b057-082792ab425d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:17.252960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbb4ee-8e54-4e04-b057-082792ab425d None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:17.259614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 653/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Aug 8 00:19:17 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:19:19.254536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea259-14c1-423e-a579-d0af575c3544 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:19.255066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea259-14c1-423e-a579-d0af575c3544 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:19.255169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea259-14c1-423e-a579-d0af575c3544 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:19.256441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 649/1302] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:19:19.261632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78f3cd-afed-47ef-8874-b95d5db9ecce None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:19.262043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78f3cd-afed-47ef-8874-b95d5db9ecce None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:19.262224 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78f3cd-afed-47ef-8874-b95d5db9ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:19.280756 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-0e78f3cd-afed-47ef-8874-b95d5db9ecce None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:19:19.281931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0e78f3cd-afed-47ef-8874-b95d5db9ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:19:19.347752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 654/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:19:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 00:19:19.370962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ea259-14c1-423e-a579-d0af575c3544 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:19.475278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:19.482920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ea259-14c1-423e-a579-d0af575c3544 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:19.525687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:19.526318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:19.526607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:19.526889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:19.527477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:19.528842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 00:19:19.537337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 00:19:19.538538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application with Lock( Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self._enter() Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application return self.creator() Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application created_value = creator( Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: ERROR keystone.server.flask.application Aug 08 00:19:19.540194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 650/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Aug 8 00:19:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 00:19:19.545081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78f3cd-afed-47ef-8874-b95d5db9ecce None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:19.619731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:19.642311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78f3cd-afed-47ef-8874-b95d5db9ecce None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:19.675473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29546e6e-34af-4aed-8548-5e3ff2f193d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:19.676063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29546e6e-34af-4aed-8548-5e3ff2f193d6 None admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:19.676352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29546e6e-34af-4aed-8548-5e3ff2f193d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:19.676661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29546e6e-34af-4aed-8548-5e3ff2f193d6 None admin] PATH_INFO: `/v3/services` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:19.677280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29546e6e-34af-4aed-8548-5e3ff2f193d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:19:19.677582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29546e6e-34af-4aed-8548-5e3ff2f193d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:19.678966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29546e6e-34af-4aed-8548-5e3ff2f193d6 None admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:19.684085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 655/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Aug 8 00:19:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:19:19.689781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:19:19.792984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3ff4-41ab-45fc-be40-9fc5b71f6852 None admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:19:19.825670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25c4de-1bcb-4f7f-a8e7-d5f9a1f53e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:19:19.826349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c4de-1bcb-4f7f-a8e7-d5f9a1f53e43 None admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:19:19.826632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c4de-1bcb-4f7f-a8e7-d5f9a1f53e43 None admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:19:19.826905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c4de-1bcb-4f7f-a8e7-d5f9a1f53e43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:19:19.827608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25c4de-1bcb-4f7f-a8e7-d5f9a1f53e43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:19:19.828971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25c4de-1bcb-4f7f-a8e7-d5f9a1f53e43 None admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:19:19.848436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 651/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:19:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:19:29.681063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=30 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:19:29.844287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:22.840611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4e8c-9450-4da8-b975-d7b5d1db41f0 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:22.841771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4e8c-9450-4da8-b975-d7b5d1db41f0 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:22.842304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4e8c-9450-4da8-b975-d7b5d1db41f0 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:22.843883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 656/1307] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:22.849097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7b0c-9136-4ac3-b024-c25497cad06f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:22.849609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7b0c-9136-4ac3-b024-c25497cad06f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:22.849694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7b0c-9136-4ac3-b024-c25497cad06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:22.927100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b2ee7b0c-9136-4ac3-b024-c25497cad06f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:22.928835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b2ee7b0c-9136-4ac3-b024-c25497cad06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:23.050575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 652/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:23.113985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2024f-def7-4b7f-a8c4-4272d4b1d3c1 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:23.113985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2024f-def7-4b7f-a8c4-4272d4b1d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:23.113985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2024f-def7-4b7f-a8c4-4272d4b1d3c1 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:23.116585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 657/1309] 10.222.0.23 () {54 vars in 965 bytes} [Mon Aug 8 00:20:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:23.123038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393542e5-ee60-416e-b069-9cc3aa9ff8ee None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:23.123548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393542e5-ee60-416e-b069-9cc3aa9ff8ee None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:23.124011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393542e5-ee60-416e-b069-9cc3aa9ff8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:23.278260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-393542e5-ee60-416e-b069-9cc3aa9ff8ee None None] MFA Rules not processed for user `17a501a048ed4b6c8186bfd490ad1394`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:23.282463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-393542e5-ee60-416e-b069-9cc3aa9ff8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:23.318967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:23.380380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 653/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Aug 8 00:20:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:23.389957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2024f-def7-4b7f-a8c4-4272d4b1d3c1 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:23.392018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c2d2024f-def7-4b7f-a8c4-4272d4b1d3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:23.508078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2024f-def7-4b7f-a8c4-4272d4b1d3c1 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:23.581938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53ae23-2a59-4e83-8abe-842423c9fdf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:23.582591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ae23-2a59-4e83-8abe-842423c9fdf2 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:23.582868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ae23-2a59-4e83-8abe-842423c9fdf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:23.583136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ae23-2a59-4e83-8abe-842423c9fdf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:23.585358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1b53ae23-2a59-4e83-8abe-842423c9fdf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:23.644016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:23.701246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53ae23-2a59-4e83-8abe-842423c9fdf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:23.702720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53ae23-2a59-4e83-8abe-842423c9fdf2 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:23.725704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 658/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:20:26.007260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2223e3-7d91-4603-925c-8019e286e9e3 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:26.007794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2223e3-7d91-4603-925c-8019e286e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:26.007794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2223e3-7d91-4603-925c-8019e286e9e3 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:26.009321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 654/1312] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:26.014266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152899-ef67-4e85-a407-2d64d8e5dff1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:26.014659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152899-ef67-4e85-a407-2d64d8e5dff1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:26.014849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152899-ef67-4e85-a407-2d64d8e5dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:26.107849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-09152899-ef67-4e85-a407-2d64d8e5dff1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:26.108990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-09152899-ef67-4e85-a407-2d64d8e5dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:26.222526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 659/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:26.262844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2223e3-7d91-4603-925c-8019e286e9e3 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:26.264402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6e2223e3-7d91-4603-925c-8019e286e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:26.384288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2223e3-7d91-4603-925c-8019e286e9e3 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:26.468448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:26.471623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178cb2-9f97-40b1-be88-7950bb6f5619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:26.472654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178cb2-9f97-40b1-be88-7950bb6f5619 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:26.473256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178cb2-9f97-40b1-be88-7950bb6f5619 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:26.473609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178cb2-9f97-40b1-be88-7950bb6f5619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:26.476190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9a178cb2-9f97-40b1-be88-7950bb6f5619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:26.592085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a178cb2-9f97-40b1-be88-7950bb6f5619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:26.593541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a178cb2-9f97-40b1-be88-7950bb6f5619 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:26.612343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 655/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:28.949385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ee7e-68d4-414c-abd6-77635c658cd7 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:28.949910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ee7e-68d4-414c-abd6-77635c658cd7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:28.949910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ee7e-68d4-414c-abd6-77635c658cd7 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:28.951451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 660/1315] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:28.956346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60e54b-929e-4cb2-bcd9-d4432351d6a3 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:28.956749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60e54b-929e-4cb2-bcd9-d4432351d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:28.956913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60e54b-929e-4cb2-bcd9-d4432351d6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:29.023168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-2e60e54b-929e-4cb2-bcd9-d4432351d6a3 None None] MFA Rules not processed for user `d6c1c3430f93463687f21fe4d5ef6201`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:29.024353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-2e60e54b-929e-4cb2-bcd9-d4432351d6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:29.074511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:29.118399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 656/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:29.158367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ee7e-68d4-414c-abd6-77635c658cd7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:29.159881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9e56ee7e-68d4-414c-abd6-77635c658cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:29.170131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:29.262295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ee7e-68d4-414c-abd6-77635c658cd7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:29.334462 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57b25e-a18a-460f-a038-e11685364378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:29.335101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57b25e-a18a-460f-a038-e11685364378 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:29.335381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57b25e-a18a-460f-a038-e11685364378 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:29.335651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57b25e-a18a-460f-a038-e11685364378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:29.337245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5c57b25e-a18a-460f-a038-e11685364378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:29.400642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:29.446628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57b25e-a18a-460f-a038-e11685364378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:29.448057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57b25e-a18a-460f-a038-e11685364378 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:29.465987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 661/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:32.027917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe93d-389c-469b-b98e-ce24453205f9 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:32.028461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe93d-389c-469b-b98e-ce24453205f9 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:32.028461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe93d-389c-469b-b98e-ce24453205f9 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:32.029824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 657/1318] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:32.034960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776762-15d6-40c4-982d-b598a1961f2f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:32.035360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776762-15d6-40c4-982d-b598a1961f2f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:32.035514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776762-15d6-40c4-982d-b598a1961f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:32.100379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b1776762-15d6-40c4-982d-b598a1961f2f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:32.101582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b1776762-15d6-40c4-982d-b598a1961f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:32.196274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 662/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:20:32.234507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbe93d-389c-469b-b98e-ce24453205f9 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:32.236031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f3cbe93d-389c-469b-b98e-ce24453205f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:32.337868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbe93d-389c-469b-b98e-ce24453205f9 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:32.415321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbf1b-24b9-42dc-ad2f-76fd85b47611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:32.415956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbf1b-24b9-42dc-ad2f-76fd85b47611 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:32.416239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbf1b-24b9-42dc-ad2f-76fd85b47611 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:32.416515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbf1b-24b9-42dc-ad2f-76fd85b47611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:32.418149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-77cdbf1b-24b9-42dc-ad2f-76fd85b47611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:32.425663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:32.532415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdbf1b-24b9-42dc-ad2f-76fd85b47611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:32.533871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdbf1b-24b9-42dc-ad2f-76fd85b47611 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:32.553109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 658/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:35.220868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539aea-1952-4fc0-9e9f-8135f7e7026a None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:35.221406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539aea-1952-4fc0-9e9f-8135f7e7026a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:35.221406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539aea-1952-4fc0-9e9f-8135f7e7026a None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:35.222836 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 663/1321] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:35.228438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c6ac-60ce-4354-9fa5-aa16e6804d23 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:35.228889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c6ac-60ce-4354-9fa5-aa16e6804d23 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:35.229026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c6ac-60ce-4354-9fa5-aa16e6804d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:35.294373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7e71c6ac-60ce-4354-9fa5-aa16e6804d23 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:35.295574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7e71c6ac-60ce-4354-9fa5-aa16e6804d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:35.358428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:35.404252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 659/1322] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:35.441581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7539aea-1952-4fc0-9e9f-8135f7e7026a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:35.443230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b7539aea-1952-4fc0-9e9f-8135f7e7026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:35.465941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:35.557503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7539aea-1952-4fc0-9e9f-8135f7e7026a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:35.631332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8803e37-774a-443a-83f1-2eacbae1c2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:35.631940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803e37-774a-443a-83f1-2eacbae1c2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:35.632223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803e37-774a-443a-83f1-2eacbae1c2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:35.632500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803e37-774a-443a-83f1-2eacbae1c2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:35.634131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b8803e37-774a-443a-83f1-2eacbae1c2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:35.708739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:35.747372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8803e37-774a-443a-83f1-2eacbae1c2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:35.748728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8803e37-774a-443a-83f1-2eacbae1c2c0 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:35.768248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 664/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:37.861837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1415f5-762b-4ce3-82ca-4e42b9226b11 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:37.862325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1415f5-762b-4ce3-82ca-4e42b9226b11 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:37.862520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1415f5-762b-4ce3-82ca-4e42b9226b11 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:37.863881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 660/1324] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:37.869723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71998-7964-4aa1-be9b-7f262a84151e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:37.870506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71998-7964-4aa1-be9b-7f262a84151e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:37.870785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71998-7964-4aa1-be9b-7f262a84151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:37.936842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-08a71998-7964-4aa1-be9b-7f262a84151e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:37.938045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-08a71998-7964-4aa1-be9b-7f262a84151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:38.034914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 665/1325] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:38.083392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68687-2f1e-4c68-a46f-5623be338eeb None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:38.083781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68687-2f1e-4c68-a46f-5623be338eeb None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:38.084123 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68687-2f1e-4c68-a46f-5623be338eeb None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:38.085554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 661/1326] 10.222.0.23 () {54 vars in 965 bytes} [Mon Aug 8 00:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:38.091405 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c657ab-7edb-4b9e-ba18-bd2c9f5ec54c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:38.091761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c657ab-7edb-4b9e-ba18-bd2c9f5ec54c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:38.092102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c657ab-7edb-4b9e-ba18-bd2c9f5ec54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:38.124025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:38.168589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-39c657ab-7edb-4b9e-ba18-bd2c9f5ec54c None None] MFA Rules not processed for user `17a501a048ed4b6c8186bfd490ad1394`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:38.169792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-39c657ab-7edb-4b9e-ba18-bd2c9f5ec54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:38.247966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 666/1327] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Aug 8 00:20:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:38.257284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff68687-2f1e-4c68-a46f-5623be338eeb None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:38.258874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0ff68687-2f1e-4c68-a46f-5623be338eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:38.365535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff68687-2f1e-4c68-a46f-5623be338eeb None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:38.449651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb85d-c7d0-4345-a21b-8a2ae0fa4c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:38.450293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb85d-c7d0-4345-a21b-8a2ae0fa4c96 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:38.450575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb85d-c7d0-4345-a21b-8a2ae0fa4c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:38.450848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb85d-c7d0-4345-a21b-8a2ae0fa4c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:38.452468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-209fb85d-c7d0-4345-a21b-8a2ae0fa4c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:38.469262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:38.572320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fb85d-c7d0-4345-a21b-8a2ae0fa4c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:38.573758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fb85d-c7d0-4345-a21b-8a2ae0fa4c96 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:38.592712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 662/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:40.880896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b36e1-7161-42cb-af34-56ca1d39ad4d None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:40.881414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b36e1-7161-42cb-af34-56ca1d39ad4d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:40.881530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b36e1-7161-42cb-af34-56ca1d39ad4d None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:40.883098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 667/1329] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:40.888232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a401-5c49-4fe4-9777-1c8db4f9337b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:40.888704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a401-5c49-4fe4-9777-1c8db4f9337b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:40.888800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a401-5c49-4fe4-9777-1c8db4f9337b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:40.954751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c037a401-5c49-4fe4-9777-1c8db4f9337b None None] MFA Rules not processed for user `d6c1c3430f93463687f21fe4d5ef6201`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:40.955957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c037a401-5c49-4fe4-9777-1c8db4f9337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:41.021475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:41.064092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 663/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:41.103119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b36e1-7161-42cb-af34-56ca1d39ad4d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:41.104677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-867b36e1-7161-42cb-af34-56ca1d39ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:41.221253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b36e1-7161-42cb-af34-56ca1d39ad4d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:41.241852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:41.296698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8803e5-8f9b-4b67-8131-37a6f2c7d895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:41.297228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8803e5-8f9b-4b67-8131-37a6f2c7d895 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:41.297508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8803e5-8f9b-4b67-8131-37a6f2c7d895 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:41.297785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8803e5-8f9b-4b67-8131-37a6f2c7d895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:41.299397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8f8803e5-8f9b-4b67-8131-37a6f2c7d895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:41.407771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8803e5-8f9b-4b67-8131-37a6f2c7d895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:41.409213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8803e5-8f9b-4b67-8131-37a6f2c7d895 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:41.428653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 668/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:43.674738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347c4f-1be6-4442-adf4-764a87e5bbdf None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:43.675386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347c4f-1be6-4442-adf4-764a87e5bbdf None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:43.675386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347c4f-1be6-4442-adf4-764a87e5bbdf None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:43.676644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 664/1332] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:43.681681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16d19-1996-4ca6-ab05-64b48a35d77f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:43.682109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16d19-1996-4ca6-ab05-64b48a35d77f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:43.682257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16d19-1996-4ca6-ab05-64b48a35d77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:43.744318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:43.746938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-03c16d19-1996-4ca6-ab05-64b48a35d77f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:43.748724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-03c16d19-1996-4ca6-ab05-64b48a35d77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:43.844393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 669/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:43.880635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347c4f-1be6-4442-adf4-764a87e5bbdf None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:43.882203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-84347c4f-1be6-4442-adf4-764a87e5bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:43.984251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347c4f-1be6-4442-adf4-764a87e5bbdf None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:44.058536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130095d-eb08-4fab-844f-3112302ea28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:44.059138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130095d-eb08-4fab-844f-3112302ea28d service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:44.059420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130095d-eb08-4fab-844f-3112302ea28d service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:44.059698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130095d-eb08-4fab-844f-3112302ea28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:44.061298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c130095d-eb08-4fab-844f-3112302ea28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:44.087783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:44.167807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130095d-eb08-4fab-844f-3112302ea28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:44.169249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130095d-eb08-4fab-844f-3112302ea28d service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:44.187666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 665/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:46.215507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a55e8-5738-4b84-ab85-2debc1a47af5 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:46.216013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a55e8-5738-4b84-ab85-2debc1a47af5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:46.216123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a55e8-5738-4b84-ab85-2debc1a47af5 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:46.217404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 670/1335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:46.222481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e163-adf4-4029-91c6-2a02765862ff None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:46.222886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e163-adf4-4029-91c6-2a02765862ff None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:46.223029 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e163-adf4-4029-91c6-2a02765862ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:46.287275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a710e163-adf4-4029-91c6-2a02765862ff None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:46.288452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a710e163-adf4-4029-91c6-2a02765862ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:46.360820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:46.383834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 666/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:46.423429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a55e8-5738-4b84-ab85-2debc1a47af5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:46.425002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1f6a55e8-5738-4b84-ab85-2debc1a47af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:46.527429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a55e8-5738-4b84-ab85-2debc1a47af5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:46.555899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:46.601213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad901a1-c982-4640-aeb4-8e57367c2d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:46.601823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad901a1-c982-4640-aeb4-8e57367c2d73 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:46.602134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad901a1-c982-4640-aeb4-8e57367c2d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:46.602407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad901a1-c982-4640-aeb4-8e57367c2d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:46.603989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6ad901a1-c982-4640-aeb4-8e57367c2d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:46.711121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad901a1-c982-4640-aeb4-8e57367c2d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:46.712548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad901a1-c982-4640-aeb4-8e57367c2d73 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:46.730453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 671/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:20:49.378501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7ab6e-757d-4b80-80d9-a7936e290f1b None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:49.379080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7ab6e-757d-4b80-80d9-a7936e290f1b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:49.379080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7ab6e-757d-4b80-80d9-a7936e290f1b None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:49.381011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 667/1338] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:49.386012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64801f-fea7-4da9-a4b2-421cb49041b0 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:49.386473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64801f-fea7-4da9-a4b2-421cb49041b0 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:49.386569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64801f-fea7-4da9-a4b2-421cb49041b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:49.450800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4f64801f-fea7-4da9-a4b2-421cb49041b0 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:49.451996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4f64801f-fea7-4da9-a4b2-421cb49041b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:49.460085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:49.550251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 672/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:49.586619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7ab6e-757d-4b80-80d9-a7936e290f1b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:49.588203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b3d7ab6e-757d-4b80-80d9-a7936e290f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:49.690678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7ab6e-757d-4b80-80d9-a7936e290f1b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:49.761938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c724eba-3282-424a-8c93-dd193a5de141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:49.762578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724eba-3282-424a-8c93-dd193a5de141 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:49.762857 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724eba-3282-424a-8c93-dd193a5de141 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:49.763130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724eba-3282-424a-8c93-dd193a5de141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:49.764708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6c724eba-3282-424a-8c93-dd193a5de141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:49.800480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:49.877089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c724eba-3282-424a-8c93-dd193a5de141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:49.878571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c724eba-3282-424a-8c93-dd193a5de141 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:49.897051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 668/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:53.961181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8048a6-567c-4b5f-86a7-f2ae47a77312 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:53.961746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8048a6-567c-4b5f-86a7-f2ae47a77312 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:53.962196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8048a6-567c-4b5f-86a7-f2ae47a77312 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:53.964510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 673/1341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:53.971626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f40e-38e9-4ccd-b61f-59bc237df737 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:53.972110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f40e-38e9-4ccd-b61f-59bc237df737 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:53.972204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f40e-38e9-4ccd-b61f-59bc237df737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:54.038869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b5a6f40e-38e9-4ccd-b61f-59bc237df737 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:54.039997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b5a6f40e-38e9-4ccd-b61f-59bc237df737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:54.125893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:54.137552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 669/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:54.177414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8048a6-567c-4b5f-86a7-f2ae47a77312 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:54.179044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fe8048a6-567c-4b5f-86a7-f2ae47a77312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:54.287312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8048a6-567c-4b5f-86a7-f2ae47a77312 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:54.326315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:54.363778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0891f4a-48c0-4567-ab07-1f6fbbd65579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:54.364377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891f4a-48c0-4567-ab07-1f6fbbd65579 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:54.364652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891f4a-48c0-4567-ab07-1f6fbbd65579 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:54.364950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891f4a-48c0-4567-ab07-1f6fbbd65579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:54.366550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d0891f4a-48c0-4567-ab07-1f6fbbd65579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:54.474472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0891f4a-48c0-4567-ab07-1f6fbbd65579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:54.475888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0891f4a-48c0-4567-ab07-1f6fbbd65579 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:54.493661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 674/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:20:57.136380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf42ba-36b7-4912-8cfe-57ebdabe9f62 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:57.136897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf42ba-36b7-4912-8cfe-57ebdabe9f62 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:57.136897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf42ba-36b7-4912-8cfe-57ebdabe9f62 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:57.138236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 670/1344] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:20:57.144399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219b27e-471a-4ddb-bcdb-70504e659f66 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:57.144963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219b27e-471a-4ddb-bcdb-70504e659f66 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:57.144963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219b27e-471a-4ddb-bcdb-70504e659f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:57.215831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a219b27e-471a-4ddb-bcdb-70504e659f66 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:20:57.217041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a219b27e-471a-4ddb-bcdb-70504e659f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:57.235477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:57.315795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 675/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:20:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:20:57.353590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf42ba-36b7-4912-8cfe-57ebdabe9f62 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:20:57.355175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-13bf42ba-36b7-4912-8cfe-57ebdabe9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:57.460334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf42ba-36b7-4912-8cfe-57ebdabe9f62 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:20:57.533306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2d4d9-909b-4140-8847-a69b10024eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:20:57.533909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d4d9-909b-4140-8847-a69b10024eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:20:57.534220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d4d9-909b-4140-8847-a69b10024eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:20:57.534500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d4d9-909b-4140-8847-a69b10024eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:20:57.536644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ddf2d4d9-909b-4140-8847-a69b10024eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:20:57.578991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:20:57.646568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2d4d9-909b-4140-8847-a69b10024eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:20:57.648026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2d4d9-909b-4140-8847-a69b10024eb3 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:20:57.667872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 671/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:20:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:01.613987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9d16b-a5b4-40fd-8fff-63d35aafb8ca None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:01.614504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9d16b-a5b4-40fd-8fff-63d35aafb8ca None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:01.614613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9d16b-a5b4-40fd-8fff-63d35aafb8ca None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:01.616109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 676/1347] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:01.621624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8e01-0e45-4d68-982f-09519853c842 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:01.622090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8e01-0e45-4d68-982f-09519853c842 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:01.622270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8e01-0e45-4d68-982f-09519853c842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:01.689281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-fdab8e01-0e45-4d68-982f-09519853c842 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:01.690523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-fdab8e01-0e45-4d68-982f-09519853c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:01.787771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:01.794114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 672/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:01.828987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9d16b-a5b4-40fd-8fff-63d35aafb8ca None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:01.830572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-abb9d16b-a5b4-40fd-8fff-63d35aafb8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:01.956022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9d16b-a5b4-40fd-8fff-63d35aafb8ca None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:02.008494 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:02.037021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b271e-6493-4f69-a629-bcc11a1f43ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:02.037626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b271e-6493-4f69-a629-bcc11a1f43ab service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:02.037903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b271e-6493-4f69-a629-bcc11a1f43ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:02.038212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b271e-6493-4f69-a629-bcc11a1f43ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:02.039808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a47b271e-6493-4f69-a629-bcc11a1f43ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:02.153132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b271e-6493-4f69-a629-bcc11a1f43ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:02.154608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b271e-6493-4f69-a629-bcc11a1f43ab service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:02.173827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 677/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:07.103948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef56f-e530-4f0e-a153-9f6261dd5721 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:07.104366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef56f-e530-4f0e-a153-9f6261dd5721 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:07.104605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef56f-e530-4f0e-a153-9f6261dd5721 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:07.106259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 673/1350] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:07.116149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466f07-83f9-45ba-acbc-c784be080dec None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:07.116897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466f07-83f9-45ba-acbc-c784be080dec None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:07.117340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466f07-83f9-45ba-acbc-c784be080dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:07.266421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-62466f07-83f9-45ba-acbc-c784be080dec None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:07.267945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-62466f07-83f9-45ba-acbc-c784be080dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:07.287916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:07.396592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 678/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:21:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:11.478176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344768a2-5740-4f3d-a91a-bb50b6b6005e None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:11.479032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344768a2-5740-4f3d-a91a-bb50b6b6005e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:11.479474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344768a2-5740-4f3d-a91a-bb50b6b6005e None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:11.481001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 674/1352] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:11.486183 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e006-1faa-4eec-83a5-46a70455431c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:11.487017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e006-1faa-4eec-83a5-46a70455431c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:11.487523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e006-1faa-4eec-83a5-46a70455431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:11.580046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6ca1e006-1faa-4eec-83a5-46a70455431c None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:11.581322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6ca1e006-1faa-4eec-83a5-46a70455431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:11.657292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:11.695321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 679/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:21:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:13.074493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf128011-d2dd-4eec-b8df-4e1b79011ba3 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:13.075029 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf128011-d2dd-4eec-b8df-4e1b79011ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:13.075124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf128011-d2dd-4eec-b8df-4e1b79011ba3 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:13.077766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 675/1354] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:13.083665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c4dd8-2af1-4871-9679-208e04edb92b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:13.084157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c4dd8-2af1-4871-9679-208e04edb92b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:13.084676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c4dd8-2af1-4871-9679-208e04edb92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:13.165193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-823c4dd8-2af1-4871-9679-208e04edb92b None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:13.166343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-823c4dd8-2af1-4871-9679-208e04edb92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:13.272328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 680/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:21:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:16.730906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac70f14-9ac0-4f41-af6f-d2195e33c895 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:16.731925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac70f14-9ac0-4f41-af6f-d2195e33c895 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:16.732443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac70f14-9ac0-4f41-af6f-d2195e33c895 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:16.734795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 676/1356] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:16.740371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb64d-de4b-4bc2-94f4-dba7ee77c836 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:16.741277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb64d-de4b-4bc2-94f4-dba7ee77c836 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:16.741776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb64d-de4b-4bc2-94f4-dba7ee77c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:16.793310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:16.833458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b5eeb64d-de4b-4bc2-94f4-dba7ee77c836 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:16.834704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b5eeb64d-de4b-4bc2-94f4-dba7ee77c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:16.945183 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 681/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:16.998404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a809c-a56f-4a17-95ca-05e774074a12 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:16.998993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a809c-a56f-4a17-95ca-05e774074a12 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:16.999487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a809c-a56f-4a17-95ca-05e774074a12 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:17.001041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 677/1358] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 8 00:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:17.017165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbac8a-447b-49ca-8453-cf237d3415e7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:17.017464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbac8a-447b-49ca-8453-cf237d3415e7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:17.017760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbac8a-447b-49ca-8453-cf237d3415e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:17.105069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4bcbac8a-447b-49ca-8453-cf237d3415e7 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:17.106206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4bcbac8a-447b-49ca-8453-cf237d3415e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:17.158962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:17.233560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 682/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 8 00:21:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:17.243047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a809c-a56f-4a17-95ca-05e774074a12 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:17.244965 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-327a809c-a56f-4a17-95ca-05e774074a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:17.418278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a809c-a56f-4a17-95ca-05e774074a12 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:17.494995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:17.539494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d946a7-10a6-48e0-935a-365e52cb3a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:17.540107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d946a7-10a6-48e0-935a-365e52cb3a57 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:17.540392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d946a7-10a6-48e0-935a-365e52cb3a57 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:17.540667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d946a7-10a6-48e0-935a-365e52cb3a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:17.542277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-64d946a7-10a6-48e0-935a-365e52cb3a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:17.635973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d946a7-10a6-48e0-935a-365e52cb3a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:17.637584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d946a7-10a6-48e0-935a-365e52cb3a57 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:17.656865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 678/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:19.858565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8e420-6fd3-4aef-bbe4-c681c5f194f7 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:19.858962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8e420-6fd3-4aef-bbe4-c681c5f194f7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:19.859120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8e420-6fd3-4aef-bbe4-c681c5f194f7 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:19.860485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 683/1361] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:19.865596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7753-c1fc-4773-b182-c8148399fb75 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:19.866096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7753-c1fc-4773-b182-c8148399fb75 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:19.866197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7753-c1fc-4773-b182-c8148399fb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:19.943581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-84be7753-c1fc-4773-b182-c8148399fb75 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:19.944811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-84be7753-c1fc-4773-b182-c8148399fb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:19.984193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:20.048146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 679/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:20.091973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8e420-6fd3-4aef-bbe4-c681c5f194f7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:20.093685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f2a8e420-6fd3-4aef-bbe4-c681c5f194f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:20.264675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8e420-6fd3-4aef-bbe4-c681c5f194f7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:20.276134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:20.396338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391c81-a874-4611-b9e9-fe36f3a7b3d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:20.396892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391c81-a874-4611-b9e9-fe36f3a7b3d7 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:20.397157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391c81-a874-4611-b9e9-fe36f3a7b3d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:20.397427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391c81-a874-4611-b9e9-fe36f3a7b3d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:20.400755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ff391c81-a874-4611-b9e9-fe36f3a7b3d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:20.501734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff391c81-a874-4611-b9e9-fe36f3a7b3d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:20.504380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff391c81-a874-4611-b9e9-fe36f3a7b3d7 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:20.525617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 684/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:22.887748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153ab9-e85a-4420-9762-6099cb87bea5 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:22.888296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153ab9-e85a-4420-9762-6099cb87bea5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:22.888296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153ab9-e85a-4420-9762-6099cb87bea5 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:22.889797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 680/1364] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:22.895449 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1075f-1cc9-4582-b8c2-4efbd8a3aa9d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:22.895942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1075f-1cc9-4582-b8c2-4efbd8a3aa9d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:22.896027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1075f-1cc9-4582-b8c2-4efbd8a3aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:22.912788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:22.967908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bef1075f-1cc9-4582-b8c2-4efbd8a3aa9d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:22.969145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bef1075f-1cc9-4582-b8c2-4efbd8a3aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:23.102143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 685/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:23.148059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a6bc-c1e8-42c4-b8cd-60d755c5aa3a None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:23.148372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a6bc-c1e8-42c4-b8cd-60d755c5aa3a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:23.148619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a6bc-c1e8-42c4-b8cd-60d755c5aa3a None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:23.150135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 681/1366] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 8 00:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:23.157617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb69a-58f2-4d85-9cb9-9b5f74315ff7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:23.158044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb69a-58f2-4d85-9cb9-9b5f74315ff7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:23.158483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb69a-58f2-4d85-9cb9-9b5f74315ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:23.252676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-44fdb69a-58f2-4d85-9cb9-9b5f74315ff7 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:23.254093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-44fdb69a-58f2-4d85-9cb9-9b5f74315ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:23.302889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:23.393626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 686/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 8 00:21:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:23.401240 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a6bc-c1e8-42c4-b8cd-60d755c5aa3a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:23.402757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-89d5a6bc-c1e8-42c4-b8cd-60d755c5aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:23.572407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a6bc-c1e8-42c4-b8cd-60d755c5aa3a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:23.598690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:23.699546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9c2c8-1161-4bc2-ab05-ee2f923008c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:23.700066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c2c8-1161-4bc2-ab05-ee2f923008c4 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:23.700346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c2c8-1161-4bc2-ab05-ee2f923008c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:23.700615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c2c8-1161-4bc2-ab05-ee2f923008c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:23.702229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-19a9c2c8-1161-4bc2-ab05-ee2f923008c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:23.796204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9c2c8-1161-4bc2-ab05-ee2f923008c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:23.797795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9c2c8-1161-4bc2-ab05-ee2f923008c4 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:23.821781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 682/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:24.885510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033052c7-bc08-469b-8f8d-3dc77d7d0b63 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:24.886099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033052c7-bc08-469b-8f8d-3dc77d7d0b63 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:24.886099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033052c7-bc08-469b-8f8d-3dc77d7d0b63 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:24.890667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 687/1369] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:24.893064 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009ebe-8f67-4d82-9fca-309ae32ef8c5 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:24.894209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009ebe-8f67-4d82-9fca-309ae32ef8c5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:24.894209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009ebe-8f67-4d82-9fca-309ae32ef8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:24.926959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:24.966502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-23009ebe-8f67-4d82-9fca-309ae32ef8c5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:24.967708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-23009ebe-8f67-4d82-9fca-309ae32ef8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:25.205210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 683/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:25.544446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fbef9-790c-4820-a0c6-03c5d4050d38 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:25.544731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fbef9-790c-4820-a0c6-03c5d4050d38 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:25.545005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fbef9-790c-4820-a0c6-03c5d4050d38 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:25.546963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 688/1371] 10.222.0.23 () {54 vars in 964 bytes} [Mon Aug 8 00:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:25.551820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c401ed-9748-487b-a425-0c7d49572695 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:25.552104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c401ed-9748-487b-a425-0c7d49572695 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:25.552374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c401ed-9748-487b-a425-0c7d49572695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:25.631932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e8c401ed-9748-487b-a425-0c7d49572695 None None] MFA Rules not processed for user `064dcac38bd1416f93bb1b763cb89f84`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:25.633229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e8c401ed-9748-487b-a425-0c7d49572695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:25.684561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:25.717715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 684/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Aug 8 00:21:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:25.726011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fbef9-790c-4820-a0c6-03c5d4050d38 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:25.727649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-684fbef9-790c-4820-a0c6-03c5d4050d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:25.836653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fbef9-790c-4820-a0c6-03c5d4050d38 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:25.886384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:25.918829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f4677-7888-48c4-a7fa-edae25760d96 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:25.919342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f4677-7888-48c4-a7fa-edae25760d96 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:25.919430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f4677-7888-48c4-a7fa-edae25760d96 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:25.920928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 685/1373] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:21:25.925547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:25.926195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:25.926477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:25.926755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:25.928385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:25.928631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a087-280b-4a34-824c-921dc0489d8b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:25.929115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a087-280b-4a34-824c-921dc0489d8b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:25.929394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a087-280b-4a34-824c-921dc0489d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:26.031249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7fe2a087-280b-4a34-824c-921dc0489d8b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:26.032465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7fe2a087-280b-4a34-824c-921dc0489d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:26.045853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:26.047603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:26.068098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 689/1374] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:26.200553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 686/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:21:26.240068 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:26.241722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:26.329406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:26.363240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067488b-d210-4207-8673-f0ca8fff8fdc service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:26.477150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59448c-dcc2-49de-a630-15c58e420f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:26.477755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59448c-dcc2-49de-a630-15c58e420f2e service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:26.478040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59448c-dcc2-49de-a630-15c58e420f2e service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:26.478340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59448c-dcc2-49de-a630-15c58e420f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:26.479939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3e59448c-dcc2-49de-a630-15c58e420f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:26.560360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:26.572230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59448c-dcc2-49de-a630-15c58e420f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:26.573821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59448c-dcc2-49de-a630-15c58e420f2e service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:26.592148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 690/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:28.640383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752e1d0-ae41-4851-9cc2-e8ea5f360def None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:28.641331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752e1d0-ae41-4851-9cc2-e8ea5f360def None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:28.641777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752e1d0-ae41-4851-9cc2-e8ea5f360def None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:28.643355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 687/1377] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:28.649348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8eba-1216-4d0a-9769-e7fc97e51766 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:28.649815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8eba-1216-4d0a-9769-e7fc97e51766 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:28.653453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8eba-1216-4d0a-9769-e7fc97e51766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:28.727694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-73aa8eba-1216-4d0a-9769-e7fc97e51766 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:28.728892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-73aa8eba-1216-4d0a-9769-e7fc97e51766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:28.825191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 691/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:28.871564 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752e1d0-ae41-4851-9cc2-e8ea5f360def None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:28.873080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f752e1d0-ae41-4851-9cc2-e8ea5f360def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:28.926170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:29.031172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752e1d0-ae41-4851-9cc2-e8ea5f360def None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:29.158763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449dffe-1769-4268-ae0a-970624075788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:29.159874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449dffe-1769-4268-ae0a-970624075788 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:29.160148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449dffe-1769-4268-ae0a-970624075788 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:29.160415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449dffe-1769-4268-ae0a-970624075788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:29.161981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3449dffe-1769-4268-ae0a-970624075788 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:29.173787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:29.251561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449dffe-1769-4268-ae0a-970624075788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:29.253676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449dffe-1769-4268-ae0a-970624075788 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:29.272098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 688/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:31.319232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31688e0-30c1-43ff-bc26-ad41cfc5c266 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:31.319774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31688e0-30c1-43ff-bc26-ad41cfc5c266 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:31.319774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31688e0-30c1-43ff-bc26-ad41cfc5c266 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:31.321284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 692/1380] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:21:31.326391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753af316-b0f3-4d20-8de2-9ccd3c35d626 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:31.326793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753af316-b0f3-4d20-8de2-9ccd3c35d626 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:31.326957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753af316-b0f3-4d20-8de2-9ccd3c35d626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:31.398924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-753af316-b0f3-4d20-8de2-9ccd3c35d626 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:31.400291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-753af316-b0f3-4d20-8de2-9ccd3c35d626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:31.487484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:31.502198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 689/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:31.545924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31688e0-30c1-43ff-bc26-ad41cfc5c266 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:31.547456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c31688e0-30c1-43ff-bc26-ad41cfc5c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:31.624738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:31.715598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31688e0-30c1-43ff-bc26-ad41cfc5c266 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:31.843536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3588cdd-00f3-445a-8825-70d1438c05da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:31.844384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588cdd-00f3-445a-8825-70d1438c05da service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:31.844669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588cdd-00f3-445a-8825-70d1438c05da service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:31.844943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588cdd-00f3-445a-8825-70d1438c05da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:31.847304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b3588cdd-00f3-445a-8825-70d1438c05da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:31.877593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:31.958109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3588cdd-00f3-445a-8825-70d1438c05da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:31.959719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3588cdd-00f3-445a-8825-70d1438c05da service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:31.979637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 693/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:34.040625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45efb-2ebc-47d9-8f4f-60ac90a95640 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:34.041414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45efb-2ebc-47d9-8f4f-60ac90a95640 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:34.041414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45efb-2ebc-47d9-8f4f-60ac90a95640 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:34.042495 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 690/1383] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:34.048776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd5af2-5d34-4e9a-9353-d030f99e414f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:34.049270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd5af2-5d34-4e9a-9353-d030f99e414f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:34.049682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd5af2-5d34-4e9a-9353-d030f99e414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:34.138767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bdbd5af2-5d34-4e9a-9353-d030f99e414f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:34.140722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bdbd5af2-5d34-4e9a-9353-d030f99e414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:34.249579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:34.253284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 694/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:21:34.298157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b45efb-2ebc-47d9-8f4f-60ac90a95640 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:34.299705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-10b45efb-2ebc-47d9-8f4f-60ac90a95640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:34.456588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b45efb-2ebc-47d9-8f4f-60ac90a95640 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:34.530854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:34.583199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e235bcd-0710-4b45-a3fb-6e20dc05ad51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:34.583801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235bcd-0710-4b45-a3fb-6e20dc05ad51 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:34.584141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235bcd-0710-4b45-a3fb-6e20dc05ad51 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:34.584342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235bcd-0710-4b45-a3fb-6e20dc05ad51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:34.585922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8e235bcd-0710-4b45-a3fb-6e20dc05ad51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:34.687820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e235bcd-0710-4b45-a3fb-6e20dc05ad51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:34.691649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e235bcd-0710-4b45-a3fb-6e20dc05ad51 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:34.718979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 691/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:36.768508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc96091-7cf2-4d1f-99bf-b04f3057f581 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:36.769062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc96091-7cf2-4d1f-99bf-b04f3057f581 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:36.769062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc96091-7cf2-4d1f-99bf-b04f3057f581 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:36.770450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 695/1386] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:36.778485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2209e-ca18-4ef9-8a17-9acd940be843 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:36.779266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2209e-ca18-4ef9-8a17-9acd940be843 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:36.779266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2209e-ca18-4ef9-8a17-9acd940be843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:36.849277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-81e2209e-ca18-4ef9-8a17-9acd940be843 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:36.851312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-81e2209e-ca18-4ef9-8a17-9acd940be843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:36.879952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:36.953280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 692/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:36.999234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc96091-7cf2-4d1f-99bf-b04f3057f581 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:37.000739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cdc96091-7cf2-4d1f-99bf-b04f3057f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:37.152860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc96091-7cf2-4d1f-99bf-b04f3057f581 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:37.224611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:37.269675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d7b24-db06-44c4-b56b-c21defada199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:37.270336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d7b24-db06-44c4-b56b-c21defada199 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:37.270612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d7b24-db06-44c4-b56b-c21defada199 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:37.270894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d7b24-db06-44c4-b56b-c21defada199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:37.272545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-548d7b24-db06-44c4-b56b-c21defada199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:37.372190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d7b24-db06-44c4-b56b-c21defada199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:37.374290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d7b24-db06-44c4-b56b-c21defada199 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:37.398868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 696/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:39.565383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99899a-c53a-4361-8b4b-945848fc085c None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:39.565987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99899a-c53a-4361-8b4b-945848fc085c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:39.566153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99899a-c53a-4361-8b4b-945848fc085c None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:39.568396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 693/1389] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:39.572829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33304-aa95-4d90-bfb9-2e752a1c9faa None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:39.573513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33304-aa95-4d90-bfb9-2e752a1c9faa None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:39.573795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33304-aa95-4d90-bfb9-2e752a1c9faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:39.640646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c4b33304-aa95-4d90-bfb9-2e752a1c9faa None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:39.641844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c4b33304-aa95-4d90-bfb9-2e752a1c9faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:39.676331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:39.738926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 697/1390] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:39.782909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99899a-c53a-4361-8b4b-945848fc085c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:39.784938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ed99899a-c53a-4361-8b4b-945848fc085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:39.934726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99899a-c53a-4361-8b4b-945848fc085c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:39.943691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:40.046886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e1475-85bc-48f5-96f1-3425af546d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:40.047487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1475-85bc-48f5-96f1-3425af546d29 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:40.047766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1475-85bc-48f5-96f1-3425af546d29 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:40.048037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1475-85bc-48f5-96f1-3425af546d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:40.050183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a94e1475-85bc-48f5-96f1-3425af546d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:40.137320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e1475-85bc-48f5-96f1-3425af546d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:40.138846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e1475-85bc-48f5-96f1-3425af546d29 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:40.157079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 694/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:41.107053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7bb39-8d68-435a-af64-8b787730bded None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:41.107593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7bb39-8d68-435a-af64-8b787730bded None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:41.107593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7bb39-8d68-435a-af64-8b787730bded None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:41.108909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 698/1392] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:41.114232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d9b9e-56c7-4cc4-abe1-8c6c333af0da None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:41.114688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d9b9e-56c7-4cc4-abe1-8c6c333af0da None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:41.114797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d9b9e-56c7-4cc4-abe1-8c6c333af0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:41.130086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:41.181117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-814d9b9e-56c7-4cc4-abe1-8c6c333af0da None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:41.182333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-814d9b9e-56c7-4cc4-abe1-8c6c333af0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:41.282240 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 695/1393] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:41.338299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db38a0-3bed-4387-a69c-df65ce3858d6 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:41.338654 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db38a0-3bed-4387-a69c-df65ce3858d6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:41.338991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db38a0-3bed-4387-a69c-df65ce3858d6 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:41.340390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 699/1394] 10.222.0.23 () {54 vars in 966 bytes} [Mon Aug 8 00:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:41.345428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420db8-a5c3-4a86-9160-d8e8dfb84446 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:41.345713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420db8-a5c3-4a86-9160-d8e8dfb84446 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:41.346015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420db8-a5c3-4a86-9160-d8e8dfb84446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:41.422440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-53420db8-a5c3-4a86-9160-d8e8dfb84446 None None] MFA Rules not processed for user `b1d5fb05964b47d5a2f33fe9dde1f65f`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:41.423548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-53420db8-a5c3-4a86-9160-d8e8dfb84446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:41.457421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:41.498611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 696/1395] 10.222.0.23 () {58 vars in 1063 bytes} [Mon Aug 8 00:21:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:41.507241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db38a0-3bed-4387-a69c-df65ce3858d6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:41.508778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c8db38a0-3bed-4387-a69c-df65ce3858d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:41.618761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db38a0-3bed-4387-a69c-df65ce3858d6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:41.683547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:41.697200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bf285-4a6b-4b7b-8ea8-eb08786e755a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d5fb05964b47d5a2f33fe9dde1f65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:41.697808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf285-4a6b-4b7b-8ea8-eb08786e755a service glance] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:41.698118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf285-4a6b-4b7b-8ea8-eb08786e755a service glance] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:41.698395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf285-4a6b-4b7b-8ea8-eb08786e755a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:41.700009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5f5bf285-4a6b-4b7b-8ea8-eb08786e755a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:41.807719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bf285-4a6b-4b7b-8ea8-eb08786e755a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:41.809153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bf285-4a6b-4b7b-8ea8-eb08786e755a service glance] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:41.828141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 700/1396] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:42.203822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd088313-89e8-45d1-9ee5-0e232eb8faeb None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:42.204319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd088313-89e8-45d1-9ee5-0e232eb8faeb None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:42.204406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd088313-89e8-45d1-9ee5-0e232eb8faeb None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:42.205804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 697/1397] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:42.211189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6236-90b7-40aa-88dd-cf91e74d418c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:42.211644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6236-90b7-40aa-88dd-cf91e74d418c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:42.211750 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6236-90b7-40aa-88dd-cf91e74d418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:42.278985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-174c6236-90b7-40aa-88dd-cf91e74d418c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:42.280085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-174c6236-90b7-40aa-88dd-cf91e74d418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:42.324971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:42.382557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 701/1398] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:21:42.429237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd088313-89e8-45d1-9ee5-0e232eb8faeb None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:42.430818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-bd088313-89e8-45d1-9ee5-0e232eb8faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:42.557482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5079cb5-b66b-4a3f-9b55-661756e44b9d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:42.557774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5079cb5-b66b-4a3f-9b55-661756e44b9d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:42.558054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5079cb5-b66b-4a3f-9b55-661756e44b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:42.591593 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd088313-89e8-45d1-9ee5-0e232eb8faeb None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:42.623618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f5079cb5-b66b-4a3f-9b55-661756e44b9d None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:42.624840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f5079cb5-b66b-4a3f-9b55-661756e44b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:42.632497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:42.709713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:42.710505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:42.710779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:42.711053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:42.712629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:42.716273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 702/1399] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:21:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:21:42.760036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142ea-9e86-416a-bde6-ad11052b99a6 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:42.760323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142ea-9e86-416a-bde6-ad11052b99a6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:42.760599 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142ea-9e86-416a-bde6-ad11052b99a6 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:42.761952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 703/1400] 10.222.0.23 () {54 vars in 943 bytes} [Mon Aug 8 00:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:21:42.768761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4322aa-babd-4f0a-b7c1-e84e234ac184 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:42.769029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4322aa-babd-4f0a-b7c1-e84e234ac184 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:42.769309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4322aa-babd-4f0a-b7c1-e84e234ac184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:42.809285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:42.810910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:42.816896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:42.830837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 698/1401] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:42.850531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bd4322aa-babd-4f0a-b7c1-e84e234ac184 None None] MFA Rules not processed for user `faeb9592d8fd4906a1298e7e550c1e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:42.851730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bd4322aa-babd-4f0a-b7c1-e84e234ac184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:42.973653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 704/1402] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Aug 8 00:21:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:21:42.983411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:42.984632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:43.038846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:43.085625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe704f1-c386-4f89-b94b-0f76343b9618 service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:43.190841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6030-0c0e-40c6-ab28-54c1977a5621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:43.191444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6030-0c0e-40c6-ab28-54c1977a5621 service swift] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:43.191719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6030-0c0e-40c6-ab28-54c1977a5621 service swift] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:43.191987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6030-0c0e-40c6-ab28-54c1977a5621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:43.193589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0e9e6030-0c0e-40c6-ab28-54c1977a5621 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:43.272092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:43.276365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e6030-0c0e-40c6-ab28-54c1977a5621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:43.277992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e6030-0c0e-40c6-ab28-54c1977a5621 service swift] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:43.285904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 699/1403] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:21:44.871007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd663c-268e-47c2-b732-3b48c5568ea2 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:44.871501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd663c-268e-47c2-b732-3b48c5568ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:44.871584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd663c-268e-47c2-b732-3b48c5568ea2 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:44.873043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 705/1404] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:44.878027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5fca-e995-42dc-8120-a19790d55193 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:44.878485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5fca-e995-42dc-8120-a19790d55193 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:44.878662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5fca-e995-42dc-8120-a19790d55193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:44.948905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-56ca5fca-e995-42dc-8120-a19790d55193 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:44.950433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-56ca5fca-e995-42dc-8120-a19790d55193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:45.097822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 700/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:45.142526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd663c-268e-47c2-b732-3b48c5568ea2 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:45.144648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1fcd663c-268e-47c2-b732-3b48c5568ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:45.250756 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:45.313337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd663c-268e-47c2-b732-3b48c5568ea2 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:45.447201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86480c-7eec-4b66-a054-29c1aad70611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:45.447741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86480c-7eec-4b66-a054-29c1aad70611 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:45.448029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86480c-7eec-4b66-a054-29c1aad70611 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:45.448310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86480c-7eec-4b66-a054-29c1aad70611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:45.449937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3e86480c-7eec-4b66-a054-29c1aad70611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:45.518947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:45.560087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86480c-7eec-4b66-a054-29c1aad70611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:45.561833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86480c-7eec-4b66-a054-29c1aad70611 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:45.583384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 706/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:47.622112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3c66c-5f0e-4621-b0e5-61d607c81feb None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:47.622672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3c66c-5f0e-4621-b0e5-61d607c81feb None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:47.622672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3c66c-5f0e-4621-b0e5-61d607c81feb None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:47.624158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 701/1407] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:21:47.629121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b109-7811-4d4d-be2c-fc51ef99fc2e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:47.629553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b109-7811-4d4d-be2c-fc51ef99fc2e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:47.629666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b109-7811-4d4d-be2c-fc51ef99fc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:47.704475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-1359b109-7811-4d4d-be2c-fc51ef99fc2e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:21:47.706278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1359b109-7811-4d4d-be2c-fc51ef99fc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:47.814114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 707/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:21:47.858888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3c66c-5f0e-4621-b0e5-61d607c81feb None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:21:47.860455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c0d3c66c-5f0e-4621-b0e5-61d607c81feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:47.948073 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:48.031968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3c66c-5f0e-4621-b0e5-61d607c81feb None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:21:48.152992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66943a-5304-4f1e-9d90-880a6d456e85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:21:48.153604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66943a-5304-4f1e-9d90-880a6d456e85 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:21:48.153885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66943a-5304-4f1e-9d90-880a6d456e85 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:21:48.154190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66943a-5304-4f1e-9d90-880a6d456e85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:21:48.155793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7c66943a-5304-4f1e-9d90-880a6d456e85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:21:48.197477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:48.259680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66943a-5304-4f1e-9d90-880a6d456e85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:21:48.261421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66943a-5304-4f1e-9d90-880a6d456e85 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:21:48.280691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 702/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:21:57.810277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=85 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:21:58.278227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=30 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:05.206603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12ebf-2c44-4ebf-a250-9b94defcbf94 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:05.207136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12ebf-2c44-4ebf-a250-9b94defcbf94 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:05.207136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12ebf-2c44-4ebf-a250-9b94defcbf94 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:05.208423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 708/1410] 10.222.0.23 () {54 vars in 918 bytes} [Mon Aug 8 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:05.213395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af25bd-e9f7-43cf-8bae-e1376cb2608a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:05.213830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af25bd-e9f7-43cf-8bae-e1376cb2608a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:05.213950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af25bd-e9f7-43cf-8bae-e1376cb2608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:05.293807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-35af25bd-e9f7-43cf-8bae-e1376cb2608a None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:05.295084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-35af25bd-e9f7-43cf-8bae-e1376cb2608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:05.406672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 703/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Aug 8 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:05.421350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261324-0f04-4f16-b80e-3180685a135a None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:05.421635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261324-0f04-4f16-b80e-3180685a135a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:05.421907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261324-0f04-4f16-b80e-3180685a135a None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:05.423296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 709/1412] 10.222.0.23 () {54 vars in 918 bytes} [Mon Aug 8 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:05.429390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f11f-923d-4efc-b1dd-95f0737b3a9b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:05.429895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f11f-923d-4efc-b1dd-95f0737b3a9b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:05.430410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f11f-923d-4efc-b1dd-95f0737b3a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:05.509715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:05.512704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-68a4f11f-923d-4efc-b1dd-95f0737b3a9b None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:05.514529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-68a4f11f-923d-4efc-b1dd-95f0737b3a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:05.637242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 704/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Aug 8 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:08.084997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc68084-fbcf-4a1c-9733-c4ba2d51a661 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:08.085519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc68084-fbcf-4a1c-9733-c4ba2d51a661 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:08.085519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc68084-fbcf-4a1c-9733-c4ba2d51a661 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:08.086873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:08.092293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaac0-4ab8-4c66-ac38-b58e4c4bbc22 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:08.092718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaac0-4ab8-4c66-ac38-b58e4c4bbc22 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:08.092850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaac0-4ab8-4c66-ac38-b58e4c4bbc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:08.159786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b2cbaac0-4ab8-4c66-ac38-b58e4c4bbc22 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:08.160972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b2cbaac0-4ab8-4c66-ac38-b58e4c4bbc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:08.214635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:08.256464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:08.299159 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc68084-fbcf-4a1c-9733-c4ba2d51a661 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:08.300786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bdc68084-fbcf-4a1c-9733-c4ba2d51a661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:08.445702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc68084-fbcf-4a1c-9733-c4ba2d51a661 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:08.520504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:08.564417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0875d81-57d1-4ab6-b0f3-3695b079f752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:08.565014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875d81-57d1-4ab6-b0f3-3695b079f752 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:08.565933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875d81-57d1-4ab6-b0f3-3695b079f752 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:08.566337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0875d81-57d1-4ab6-b0f3-3695b079f752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:08.567912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a0875d81-57d1-4ab6-b0f3-3695b079f752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:08.656305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0875d81-57d1-4ab6-b0f3-3695b079f752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:08.657976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0875d81-57d1-4ab6-b0f3-3695b079f752 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:08.676485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 711/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:09.590395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7633e9-9e2c-40a9-b767-655b175f23d5 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:09.590972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7633e9-9e2c-40a9-b767-655b175f23d5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:09.590972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7633e9-9e2c-40a9-b767-655b175f23d5 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:09.592301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:09.597742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33beb3-f352-4a77-9999-efdfd2819546 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:09.598195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33beb3-f352-4a77-9999-efdfd2819546 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:09.598310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33beb3-f352-4a77-9999-efdfd2819546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:09.672866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8c33beb3-f352-4a77-9999-efdfd2819546 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:09.674079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8c33beb3-f352-4a77-9999-efdfd2819546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:09.700337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:09.780071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:09.937806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7633e9-9e2c-40a9-b767-655b175f23d5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:09.939326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7d7633e9-9e2c-40a9-b767-655b175f23d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:10.083534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7633e9-9e2c-40a9-b767-655b175f23d5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:10.125976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:10.199771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750450a-c06b-4bb2-9a46-84609dea7f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:10.200359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750450a-c06b-4bb2-9a46-84609dea7f6b service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:10.200644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750450a-c06b-4bb2-9a46-84609dea7f6b service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:10.200922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750450a-c06b-4bb2-9a46-84609dea7f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:10.202553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f750450a-c06b-4bb2-9a46-84609dea7f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:10.289396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750450a-c06b-4bb2-9a46-84609dea7f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:10.291025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750450a-c06b-4bb2-9a46-84609dea7f6b service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:10.309093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 707/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:11.187387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c649e-4e5e-4d39-84f8-04cdb0497ec7 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:11.187896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c649e-4e5e-4d39-84f8-04cdb0497ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:11.187896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c649e-4e5e-4d39-84f8-04cdb0497ec7 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:11.189207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:11.194620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79404ac3-fd2c-428e-bdcd-508c4ad2cd18 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:11.195010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79404ac3-fd2c-428e-bdcd-508c4ad2cd18 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:11.195172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79404ac3-fd2c-428e-bdcd-508c4ad2cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:11.249498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:11.271824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-79404ac3-fd2c-428e-bdcd-508c4ad2cd18 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:11.273012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-79404ac3-fd2c-428e-bdcd-508c4ad2cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:11.366297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:11.529813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c649e-4e5e-4d39-84f8-04cdb0497ec7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:11.531359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2b5c649e-4e5e-4d39-84f8-04cdb0497ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:11.676630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c649e-4e5e-4d39-84f8-04cdb0497ec7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:11.688521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:11.910559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48f98-c411-4579-95ca-c01cfc5632e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:11.911161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48f98-c411-4579-95ca-c01cfc5632e5 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:11.911436 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48f98-c411-4579-95ca-c01cfc5632e5 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:11.911704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48f98-c411-4579-95ca-c01cfc5632e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:11.913361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cff48f98-c411-4579-95ca-c01cfc5632e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:12.002148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff48f98-c411-4579-95ca-c01cfc5632e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:12.003764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff48f98-c411-4579-95ca-c01cfc5632e5 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:12.021547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 714/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:12.874629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91444-f123-4370-a4ac-3a903f06654d None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:12.875030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91444-f123-4370-a4ac-3a903f06654d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:12.875200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91444-f123-4370-a4ac-3a903f06654d None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:12.876553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:12.881895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95b701-7710-447b-abc6-895e3e188ef7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:12.882365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95b701-7710-447b-abc6-895e3e188ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:12.882470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95b701-7710-447b-abc6-895e3e188ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:12.902749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:12.960708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-2d95b701-7710-447b-abc6-895e3e188ef7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:12.962314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2d95b701-7710-447b-abc6-895e3e188ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:13.060392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:13.210157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91444-f123-4370-a4ac-3a903f06654d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:13.211619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4db91444-f123-4370-a4ac-3a903f06654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:13.319869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:13.356097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91444-f123-4370-a4ac-3a903f06654d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:13.467167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff0e6e-5c3b-41bc-ba56-2ae67efc48f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:13.467762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0e6e-5c3b-41bc-ba56-2ae67efc48f9 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:13.468042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0e6e-5c3b-41bc-ba56-2ae67efc48f9 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:13.468313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0e6e-5c3b-41bc-ba56-2ae67efc48f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:13.469892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a1ff0e6e-5c3b-41bc-ba56-2ae67efc48f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:13.544448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:13.558126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff0e6e-5c3b-41bc-ba56-2ae67efc48f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:13.559726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff0e6e-5c3b-41bc-ba56-2ae67efc48f9 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:13.578354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 710/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:14.432933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f521c-59b4-4be5-af9a-fe67f6e6ed8b None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:14.433500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f521c-59b4-4be5-af9a-fe67f6e6ed8b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:14.433500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f521c-59b4-4be5-af9a-fe67f6e6ed8b None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:14.434851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:14.439841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87315115-efd0-4bc5-ab67-b12eecfecd26 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:14.440281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87315115-efd0-4bc5-ab67-b12eecfecd26 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:14.440386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87315115-efd0-4bc5-ab67-b12eecfecd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:14.514960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-87315115-efd0-4bc5-ab67-b12eecfecd26 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:14.516399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-87315115-efd0-4bc5-ab67-b12eecfecd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:14.611063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:22:14.758377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f521c-59b4-4be5-af9a-fe67f6e6ed8b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:14.759870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-336f521c-59b4-4be5-af9a-fe67f6e6ed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:14.844628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:14.906977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f521c-59b4-4be5-af9a-fe67f6e6ed8b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:15.019234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43670b5a-db63-4d54-852c-e7f2eefdaa56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:15.020350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43670b5a-db63-4d54-852c-e7f2eefdaa56 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:15.020639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43670b5a-db63-4d54-852c-e7f2eefdaa56 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:15.020903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43670b5a-db63-4d54-852c-e7f2eefdaa56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:15.022501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-43670b5a-db63-4d54-852c-e7f2eefdaa56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:15.068712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:15.114868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43670b5a-db63-4d54-852c-e7f2eefdaa56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:15.117304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43670b5a-db63-4d54-852c-e7f2eefdaa56 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:15.142172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 717/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:15.930684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf864c9-f9f8-440c-8006-a34528288811 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:15.931227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf864c9-f9f8-440c-8006-a34528288811 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:15.931227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf864c9-f9f8-440c-8006-a34528288811 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:15.932574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:15.937433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74a93-ff11-4ab4-8a39-accae5c07d04 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:15.937830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74a93-ff11-4ab4-8a39-accae5c07d04 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:15.937988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74a93-ff11-4ab4-8a39-accae5c07d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:16.013664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e2d74a93-ff11-4ab4-8a39-accae5c07d04 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:16.014906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e2d74a93-ff11-4ab4-8a39-accae5c07d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:16.109686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:16.258623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf864c9-f9f8-440c-8006-a34528288811 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:16.260133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cdf864c9-f9f8-440c-8006-a34528288811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:16.308573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:16.404173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf864c9-f9f8-440c-8006-a34528288811 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:16.516981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baccaf9-ee03-4453-89bc-5acea7958be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:16.517603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baccaf9-ee03-4453-89bc-5acea7958be6 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:16.517888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baccaf9-ee03-4453-89bc-5acea7958be6 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:16.518197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baccaf9-ee03-4453-89bc-5acea7958be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:16.520424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0baccaf9-ee03-4453-89bc-5acea7958be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:16.527975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:16.610362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baccaf9-ee03-4453-89bc-5acea7958be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:16.611961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baccaf9-ee03-4453-89bc-5acea7958be6 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:16.629995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 713/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:17.437360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5adcbd-bfc3-41e5-9e9b-0e284e972448 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:17.437894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5adcbd-bfc3-41e5-9e9b-0e284e972448 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:17.437894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5adcbd-bfc3-41e5-9e9b-0e284e972448 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:17.439306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:17.444266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e2aca-81c1-4ffb-9407-802227cf53ce None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:17.444719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e2aca-81c1-4ffb-9407-802227cf53ce None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:17.444818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e2aca-81c1-4ffb-9407-802227cf53ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:17.520966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-ca7e2aca-81c1-4ffb-9407-802227cf53ce None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:17.522194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ca7e2aca-81c1-4ffb-9407-802227cf53ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:17.588255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:17.618419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:17.767777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5adcbd-bfc3-41e5-9e9b-0e284e972448 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:17.769361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8f5adcbd-bfc3-41e5-9e9b-0e284e972448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:17.787886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:17.915852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5adcbd-bfc3-41e5-9e9b-0e284e972448 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:18.000160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:18.026833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb327ae-aba2-479a-99b2-8f06f92708bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:18.027365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb327ae-aba2-479a-99b2-8f06f92708bf service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:18.027643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb327ae-aba2-479a-99b2-8f06f92708bf service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:18.027915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb327ae-aba2-479a-99b2-8f06f92708bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:18.029493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6eb327ae-aba2-479a-99b2-8f06f92708bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:18.116372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb327ae-aba2-479a-99b2-8f06f92708bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:18.117946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb327ae-aba2-479a-99b2-8f06f92708bf service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:18.135769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 720/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:18.929393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd12ab8-868b-4b8b-9d07-707d0122c551 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:18.929934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd12ab8-868b-4b8b-9d07-707d0122c551 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:18.929934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd12ab8-868b-4b8b-9d07-707d0122c551 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:18.931341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:18.936283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a58df6-a81a-413e-b165-28a251f5a830 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:18.936656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a58df6-a81a-413e-b165-28a251f5a830 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:18.936834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a58df6-a81a-413e-b165-28a251f5a830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:19.014762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-40a58df6-a81a-413e-b165-28a251f5a830 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:19.016239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-40a58df6-a81a-413e-b165-28a251f5a830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:19.057350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:19.111141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:19.259991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd12ab8-868b-4b8b-9d07-707d0122c551 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:19.261486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dcd12ab8-868b-4b8b-9d07-707d0122c551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:19.403447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd12ab8-868b-4b8b-9d07-707d0122c551 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:19.456812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:19.516531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d32f6-9496-4231-b25b-7ea813018410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:19.517134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d32f6-9496-4231-b25b-7ea813018410 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:19.517415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d32f6-9496-4231-b25b-7ea813018410 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:19.517688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d32f6-9496-4231-b25b-7ea813018410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:19.519338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-2a9d32f6-9496-4231-b25b-7ea813018410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:19.609308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d32f6-9496-4231-b25b-7ea813018410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:19.610928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d32f6-9496-4231-b25b-7ea813018410 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:19.630184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 716/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:20.433113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee1876-e2ec-4a91-8608-9f344d87b171 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:20.433778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee1876-e2ec-4a91-8608-9f344d87b171 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:20.433778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee1876-e2ec-4a91-8608-9f344d87b171 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:20.435049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:20.440086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50ef4-56ee-4ef0-bcb4-1783f4c381b5 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:20.440491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50ef4-56ee-4ef0-bcb4-1783f4c381b5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:20.440641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50ef4-56ee-4ef0-bcb4-1783f4c381b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:20.517002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-81c50ef4-56ee-4ef0-bcb4-1783f4c381b5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:20.518224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-81c50ef4-56ee-4ef0-bcb4-1783f4c381b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:20.520809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:20.613230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:20.763191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee1876-e2ec-4a91-8608-9f344d87b171 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:20.764839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-69ee1876-e2ec-4a91-8608-9f344d87b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:20.911631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee1876-e2ec-4a91-8608-9f344d87b171 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:20.938095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:21.034973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736a93e-0520-4a1e-a401-a89b47fa1f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:21.035992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736a93e-0520-4a1e-a401-a89b47fa1f64 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:21.036271 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736a93e-0520-4a1e-a401-a89b47fa1f64 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:21.036540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736a93e-0520-4a1e-a401-a89b47fa1f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:21.038179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9736a93e-0520-4a1e-a401-a89b47fa1f64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:21.125893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736a93e-0520-4a1e-a401-a89b47fa1f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:21.127513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736a93e-0520-4a1e-a401-a89b47fa1f64 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:21.146041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 723/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:23.075513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c09ac-15db-4bfb-be65-a45285298739 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:23.076077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c09ac-15db-4bfb-be65-a45285298739 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:23.076077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c09ac-15db-4bfb-be65-a45285298739 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:23.077399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:22:23.083247 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03253a71-17d1-49b5-a422-187a37051446 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:23.083666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03253a71-17d1-49b5-a422-187a37051446 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:23.083790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03253a71-17d1-49b5-a422-187a37051446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:23.124904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:23.150667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-03253a71-17d1-49b5-a422-187a37051446 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:23.151880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-03253a71-17d1-49b5-a422-187a37051446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:23.246669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:23.287256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c09ac-15db-4bfb-be65-a45285298739 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:23.288785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f80c09ac-15db-4bfb-be65-a45285298739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:23.391925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c09ac-15db-4bfb-be65-a45285298739 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:23.423388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:23.464230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870effa5-9ef9-420c-a113-2446d6746851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:23.464824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870effa5-9ef9-420c-a113-2446d6746851 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:23.465103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870effa5-9ef9-420c-a113-2446d6746851 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:23.465374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870effa5-9ef9-420c-a113-2446d6746851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:23.467024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-870effa5-9ef9-420c-a113-2446d6746851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:23.574174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870effa5-9ef9-420c-a113-2446d6746851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:23.575620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870effa5-9ef9-420c-a113-2446d6746851 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:23.593633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 719/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:25.806844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5531479-cae2-48c1-83d9-afed8223dca4 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:25.807404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5531479-cae2-48c1-83d9-afed8223dca4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:25.807404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5531479-cae2-48c1-83d9-afed8223dca4 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:25.808728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:25.814014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbb638-2428-4ce6-a8ed-eb29467f7ec1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:25.814503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbb638-2428-4ce6-a8ed-eb29467f7ec1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:25.814612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbb638-2428-4ce6-a8ed-eb29467f7ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:25.881109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-61dbb638-2428-4ce6-a8ed-eb29467f7ec1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:25.882359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-61dbb638-2428-4ce6-a8ed-eb29467f7ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:25.895794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:25.978529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:26.017017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5531479-cae2-48c1-83d9-afed8223dca4 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:26.018585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a5531479-cae2-48c1-83d9-afed8223dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:26.121385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5531479-cae2-48c1-83d9-afed8223dca4 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:26.133085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:26.196799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56bca-d05a-4fac-98d8-1c0de9b892c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:26.197392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56bca-d05a-4fac-98d8-1c0de9b892c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:26.197667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56bca-d05a-4fac-98d8-1c0de9b892c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:26.197932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56bca-d05a-4fac-98d8-1c0de9b892c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:26.199542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-92b56bca-d05a-4fac-98d8-1c0de9b892c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:26.307178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b56bca-d05a-4fac-98d8-1c0de9b892c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:26.308603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b56bca-d05a-4fac-98d8-1c0de9b892c2 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:26.326560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 726/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:22:28.630720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560a8e-d4a2-4708-8fd9-5c70b48715c6 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:28.631257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560a8e-d4a2-4708-8fd9-5c70b48715c6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:28.631354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560a8e-d4a2-4708-8fd9-5c70b48715c6 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:28.632688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:28.638383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d303f15-6985-44be-8735-e8abad35e468 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:28.638825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d303f15-6985-44be-8735-e8abad35e468 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:28.638931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d303f15-6985-44be-8735-e8abad35e468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:28.687072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:28.705399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-3d303f15-6985-44be-8735-e8abad35e468 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:28.706636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3d303f15-6985-44be-8735-e8abad35e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:28.800326 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:28.840320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba560a8e-d4a2-4708-8fd9-5c70b48715c6 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:28.841889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ba560a8e-d4a2-4708-8fd9-5c70b48715c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:28.944318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba560a8e-d4a2-4708-8fd9-5c70b48715c6 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:28.983561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:29.017992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7fb15-1249-499c-abb3-211e0cbbca9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:29.018630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7fb15-1249-499c-abb3-211e0cbbca9b service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:29.018913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7fb15-1249-499c-abb3-211e0cbbca9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:29.019187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7fb15-1249-499c-abb3-211e0cbbca9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:29.020802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d2d7fb15-1249-499c-abb3-211e0cbbca9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:29.129468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7fb15-1249-499c-abb3-211e0cbbca9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:29.130864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7fb15-1249-499c-abb3-211e0cbbca9b service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:29.149021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 722/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:31.268293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fbe68-826b-4665-8552-6bd5f6682190 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:31.268874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fbe68-826b-4665-8552-6bd5f6682190 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:31.268874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fbe68-826b-4665-8552-6bd5f6682190 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:31.270748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:31.275913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc7f5-f7e4-4634-8385-7eeb7574e4da None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:31.276331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc7f5-f7e4-4634-8385-7eeb7574e4da None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:31.276466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc7f5-f7e4-4634-8385-7eeb7574e4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:31.344743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-124dc7f5-f7e4-4634-8385-7eeb7574e4da None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:31.345953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-124dc7f5-f7e4-4634-8385-7eeb7574e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:31.366711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:31.442829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:31.481408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fbe68-826b-4665-8552-6bd5f6682190 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:31.482953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-639fbe68-826b-4665-8552-6bd5f6682190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:31.584575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fbe68-826b-4665-8552-6bd5f6682190 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:31.603662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:31.673392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439e6f0-2d63-40dc-bff3-216f874e59b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:31.673993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e6f0-2d63-40dc-bff3-216f874e59b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:31.674296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e6f0-2d63-40dc-bff3-216f874e59b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:31.674560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e6f0-2d63-40dc-bff3-216f874e59b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:31.676140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2439e6f0-2d63-40dc-bff3-216f874e59b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:31.783849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439e6f0-2d63-40dc-bff3-216f874e59b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:31.785285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439e6f0-2d63-40dc-bff3-216f874e59b4 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:31.803507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 729/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:33.930399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980d7b-3512-4b5e-ac7b-97434e6960c5 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:33.930952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980d7b-3512-4b5e-ac7b-97434e6960c5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:33.930952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980d7b-3512-4b5e-ac7b-97434e6960c5 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:33.932308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:33.937718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2acf9-caf6-4f7a-8408-96ef26efc46c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:33.938145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2acf9-caf6-4f7a-8408-96ef26efc46c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:33.938310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2acf9-caf6-4f7a-8408-96ef26efc46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:33.999974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:34.002606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6ef2acf9-caf6-4f7a-8408-96ef26efc46c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:34.004944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6ef2acf9-caf6-4f7a-8408-96ef26efc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:34.100505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:22:34.139062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e980d7b-3512-4b5e-ac7b-97434e6960c5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:34.140647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0e980d7b-3512-4b5e-ac7b-97434e6960c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:34.242683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e980d7b-3512-4b5e-ac7b-97434e6960c5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:34.292268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:34.318333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882fd29-8299-47a6-b3cd-ff5ceb2c458a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:34.318953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882fd29-8299-47a6-b3cd-ff5ceb2c458a service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:34.319237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882fd29-8299-47a6-b3cd-ff5ceb2c458a service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:34.319514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882fd29-8299-47a6-b3cd-ff5ceb2c458a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:34.321120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f882fd29-8299-47a6-b3cd-ff5ceb2c458a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:34.432170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882fd29-8299-47a6-b3cd-ff5ceb2c458a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:34.433534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882fd29-8299-47a6-b3cd-ff5ceb2c458a service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:34.451628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 725/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:36.509243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256721-063f-4cbd-872c-2643c89daa3a None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:36.509830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256721-063f-4cbd-872c-2643c89daa3a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:36.509830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256721-063f-4cbd-872c-2643c89daa3a None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:36.511154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:36.516814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0e0c-df5c-4da4-9d65-0ae535f98de7 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:36.517251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0e0c-df5c-4da4-9d65-0ae535f98de7 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:36.517349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0e0c-df5c-4da4-9d65-0ae535f98de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:36.584012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e39c0e0c-df5c-4da4-9d65-0ae535f98de7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:36.585214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e39c0e0c-df5c-4da4-9d65-0ae535f98de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:36.615233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:36.682262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:22:36.720844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5256721-063f-4cbd-872c-2643c89daa3a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:36.722414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b5256721-063f-4cbd-872c-2643c89daa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:36.826582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5256721-063f-4cbd-872c-2643c89daa3a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:36.858668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:36.901392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96d0c8-4a76-4863-9d3d-ab5b04f350c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:36.901994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96d0c8-4a76-4863-9d3d-ab5b04f350c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:36.902304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96d0c8-4a76-4863-9d3d-ab5b04f350c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:36.902577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96d0c8-4a76-4863-9d3d-ab5b04f350c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:36.904154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-aa96d0c8-4a76-4863-9d3d-ab5b04f350c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:37.010739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96d0c8-4a76-4863-9d3d-ab5b04f350c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:37.012164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96d0c8-4a76-4863-9d3d-ab5b04f350c2 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:37.030539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 732/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:39.100898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab064c-8bea-4eea-ab6b-e5a52285d3ba None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:39.101642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab064c-8bea-4eea-ab6b-e5a52285d3ba None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:39.101642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab064c-8bea-4eea-ab6b-e5a52285d3ba None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:39.102846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:22:39.108353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcccc0-af14-4dfd-975a-a4c63c842006 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:39.108779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcccc0-af14-4dfd-975a-a4c63c842006 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:39.108897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcccc0-af14-4dfd-975a-a4c63c842006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:39.176123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a6fcccc0-af14-4dfd-975a-a4c63c842006 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:39.177334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a6fcccc0-af14-4dfd-975a-a4c63c842006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:39.185449 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:39.280560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:39.318105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab064c-8bea-4eea-ab6b-e5a52285d3ba None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:39.319548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-10ab064c-8bea-4eea-ab6b-e5a52285d3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:39.429021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab064c-8bea-4eea-ab6b-e5a52285d3ba None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:39.488271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:39.507179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da5119-2a4c-4d2e-a963-615729f88193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:39.507820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5119-2a4c-4d2e-a963-615729f88193 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:39.508106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5119-2a4c-4d2e-a963-615729f88193 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:39.508433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5119-2a4c-4d2e-a963-615729f88193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:39.510090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-68da5119-2a4c-4d2e-a963-615729f88193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:39.616728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da5119-2a4c-4d2e-a963-615729f88193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:39.618197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da5119-2a4c-4d2e-a963-615729f88193 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:39.635976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 728/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:41.694845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebf53-f966-4fe3-8161-d89dc85ed9bf None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:41.695406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebf53-f966-4fe3-8161-d89dc85ed9bf None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:41.695406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ebf53-f966-4fe3-8161-d89dc85ed9bf None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:41.696752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:41.701897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b30ad7-0359-481f-a60f-04af7551d80a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:41.702360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b30ad7-0359-481f-a60f-04af7551d80a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:41.702481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b30ad7-0359-481f-a60f-04af7551d80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:41.766850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-21b30ad7-0359-481f-a60f-04af7551d80a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:41.768040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-21b30ad7-0359-481f-a60f-04af7551d80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:41.805533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:41.863865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:41.901649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ebf53-f966-4fe3-8161-d89dc85ed9bf None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:41.903189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ac5ebf53-f966-4fe3-8161-d89dc85ed9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:42.012601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ebf53-f966-4fe3-8161-d89dc85ed9bf None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:42.050719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:42.087742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a936-3263-4d5d-b135-9a55d6024766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:42.088346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a936-3263-4d5d-b135-9a55d6024766 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:42.088627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a936-3263-4d5d-b135-9a55d6024766 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:42.088900 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a936-3263-4d5d-b135-9a55d6024766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:42.090532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1711a936-3263-4d5d-b135-9a55d6024766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:42.198084 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711a936-3263-4d5d-b135-9a55d6024766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:42.199586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711a936-3263-4d5d-b135-9a55d6024766 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:42.217693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 735/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:44.239151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180fd42-2074-4a85-916c-10140b220a6e None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:44.239706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180fd42-2074-4a85-916c-10140b220a6e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:44.239706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180fd42-2074-4a85-916c-10140b220a6e None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:44.241047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:44.246324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc0ea-e5b8-48c0-a21b-f4027c4bd067 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:44.246717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc0ea-e5b8-48c0-a21b-f4027c4bd067 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:44.246881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc0ea-e5b8-48c0-a21b-f4027c4bd067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:44.312196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f86bc0ea-e5b8-48c0-a21b-f4027c4bd067 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:44.313384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f86bc0ea-e5b8-48c0-a21b-f4027c4bd067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:44.330612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:44.408468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:44.445438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180fd42-2074-4a85-916c-10140b220a6e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:44.446995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7180fd42-2074-4a85-916c-10140b220a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:44.549212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180fd42-2074-4a85-916c-10140b220a6e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:44.614188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:44.621234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89075-af43-4a02-a888-7622ad6b6a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:44.621830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89075-af43-4a02-a888-7622ad6b6a74 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:44.622139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89075-af43-4a02-a888-7622ad6b6a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:44.622409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89075-af43-4a02-a888-7622ad6b6a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:44.623975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-30f89075-af43-4a02-a888-7622ad6b6a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:44.729566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89075-af43-4a02-a888-7622ad6b6a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:44.731011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89075-af43-4a02-a888-7622ad6b6a74 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:44.749247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 731/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:46.741912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f7a3c-efb1-4771-b4d3-396edfe1c661 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:46.742495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f7a3c-efb1-4771-b4d3-396edfe1c661 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:46.742495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f7a3c-efb1-4771-b4d3-396edfe1c661 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:46.743863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:22:46.748970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7fcba-d7e0-4052-92de-44ff41e415d2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:46.749365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7fcba-d7e0-4052-92de-44ff41e415d2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:46.749522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7fcba-d7e0-4052-92de-44ff41e415d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:46.815184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3da7fcba-d7e0-4052-92de-44ff41e415d2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:22:46.816307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3da7fcba-d7e0-4052-92de-44ff41e415d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:46.865408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:46.913602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:22:46.948833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f7a3c-efb1-4771-b4d3-396edfe1c661 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:22:46.950388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-061f7a3c-efb1-4771-b4d3-396edfe1c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:47.054981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f7a3c-efb1-4771-b4d3-396edfe1c661 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:22:47.102829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:47.128817 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c150e7-7d94-4aae-a7ea-e5ae7a15ba54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:22:47.129417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c150e7-7d94-4aae-a7ea-e5ae7a15ba54 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:22:47.129696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c150e7-7d94-4aae-a7ea-e5ae7a15ba54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:22:47.130042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c150e7-7d94-4aae-a7ea-e5ae7a15ba54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:22:47.132070 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f2c150e7-7d94-4aae-a7ea-e5ae7a15ba54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:22:47.242629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c150e7-7d94-4aae-a7ea-e5ae7a15ba54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:22:47.244058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c150e7-7d94-4aae-a7ea-e5ae7a15ba54 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:22:47.262607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 738/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:22:56.911863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=22 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:22:57.260318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=66 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:06.692189 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652829e-5039-4291-8325-23d6d09e63a6 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:06.692737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652829e-5039-4291-8325-23d6d09e63a6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:06.692737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652829e-5039-4291-8325-23d6d09e63a6 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:06.694103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 733/1471] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:23:06.699205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac044-0f80-4a44-904e-27ac138bbd95 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:06.699612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac044-0f80-4a44-904e-27ac138bbd95 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:06.699756 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac044-0f80-4a44-904e-27ac138bbd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:06.765075 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c88ac044-0f80-4a44-904e-27ac138bbd95 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:23:06.766580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c88ac044-0f80-4a44-904e-27ac138bbd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:06.868122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 739/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:23:06.953587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973b0d-3b0e-4107-bb25-494615a87575 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:06.953943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973b0d-3b0e-4107-bb25-494615a87575 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:06.954267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973b0d-3b0e-4107-bb25-494615a87575 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:06.955608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 734/1473] 10.222.0.23 () {54 vars in 966 bytes} [Mon Aug 8 00:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:23:06.961052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef954-15c5-4539-add0-56e811c76f31 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:06.961345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef954-15c5-4539-add0-56e811c76f31 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:06.961620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef954-15c5-4539-add0-56e811c76f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:07.038880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-477ef954-15c5-4539-add0-56e811c76f31 None None] MFA Rules not processed for user `b1d5fb05964b47d5a2f33fe9dde1f65f`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:23:07.040101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-477ef954-15c5-4539-add0-56e811c76f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:07.060748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:07.116661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 740/1474] 10.222.0.23 () {58 vars in 1063 bytes} [Mon Aug 8 00:23:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:23:07.124111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973b0d-3b0e-4107-bb25-494615a87575 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:23:07.125692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-13973b0d-3b0e-4107-bb25-494615a87575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:07.238382 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973b0d-3b0e-4107-bb25-494615a87575 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:23:07.311820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dc40b-32c9-4fff-997e-37716742da74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d5fb05964b47d5a2f33fe9dde1f65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:23:07.312430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc40b-32c9-4fff-997e-37716742da74 service glance] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:07.312711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc40b-32c9-4fff-997e-37716742da74 service glance] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:07.312979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc40b-32c9-4fff-997e-37716742da74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:07.314604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cb3dc40b-32c9-4fff-997e-37716742da74 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:07.368082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:07.423152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dc40b-32c9-4fff-997e-37716742da74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:23:07.424595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dc40b-32c9-4fff-997e-37716742da74 service glance] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:23:07.443184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 735/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:23:09.508598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded200-8f9e-46cb-82de-aa3368bdc845 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:09.509164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded200-8f9e-46cb-82de-aa3368bdc845 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:09.509164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded200-8f9e-46cb-82de-aa3368bdc845 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:09.510573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 741/1476] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:23:09.515890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615bed1-20a5-4c10-85ac-57d6d21a67af None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:09.516582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615bed1-20a5-4c10-85ac-57d6d21a67af None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:09.516693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615bed1-20a5-4c10-85ac-57d6d21a67af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:09.582392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-0615bed1-20a5-4c10-85ac-57d6d21a67af None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:23:09.583584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0615bed1-20a5-4c10-85ac-57d6d21a67af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:09.677479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 736/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:23:09.700411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaded200-8f9e-46cb-82de-aa3368bdc845 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:23:09.701947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-aaded200-8f9e-46cb-82de-aa3368bdc845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:09.825864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaded200-8f9e-46cb-82de-aa3368bdc845 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:23:09.875237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:09.920727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6509f3-16e7-43e9-9a4d-bf8b6b9a140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:23:09.921331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6509f3-16e7-43e9-9a4d-bf8b6b9a140b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:09.921613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6509f3-16e7-43e9-9a4d-bf8b6b9a140b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:09.921883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6509f3-16e7-43e9-9a4d-bf8b6b9a140b admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:09.922541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6509f3-16e7-43e9-9a4d-bf8b6b9a140b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:23:09.924254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING py.warnings [None req-ea6509f3-16e7-43e9-9a4d-bf8b6b9a140b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:23:09.924254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: warnings.warn(msg) Aug 08 00:23:09.924254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: Aug 08 00:23:09.925420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6509f3-16e7-43e9-9a4d-bf8b6b9a140b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:23:09.944205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 742/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Aug 8 00:23:09 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:23:11.972989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d816b-2b46-4a7d-8554-5c5b3234c130 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:11.973542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d816b-2b46-4a7d-8554-5c5b3234c130 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:11.973542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d816b-2b46-4a7d-8554-5c5b3234c130 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:11.974920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 737/1479] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:23:11.980028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b519-989a-46a8-a7d0-7c97875325a0 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:11.980426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b519-989a-46a8-a7d0-7c97875325a0 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:11.980613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b519-989a-46a8-a7d0-7c97875325a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:12.045806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a357b519-989a-46a8-a7d0-7c97875325a0 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:23:12.047041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a357b519-989a-46a8-a7d0-7c97875325a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:12.143165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 743/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:23:12.186459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d816b-2b46-4a7d-8554-5c5b3234c130 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:23:12.188039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3f7d816b-2b46-4a7d-8554-5c5b3234c130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:12.197843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:12.333115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d816b-2b46-4a7d-8554-5c5b3234c130 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:23:12.411149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:12.443304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df94cf-8b30-4e07-aac5-12555803ed63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:23:12.443894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df94cf-8b30-4e07-aac5-12555803ed63 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:12.444168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df94cf-8b30-4e07-aac5-12555803ed63 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:12.444436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df94cf-8b30-4e07-aac5-12555803ed63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:12.446000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-47df94cf-8b30-4e07-aac5-12555803ed63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:12.532701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df94cf-8b30-4e07-aac5-12555803ed63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:23:12.534961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df94cf-8b30-4e07-aac5-12555803ed63 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:23:12.552892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 738/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:23:14.701856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7526e3-6682-45f4-b20a-1f50895540c8 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:14.702415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7526e3-6682-45f4-b20a-1f50895540c8 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:14.702415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7526e3-6682-45f4-b20a-1f50895540c8 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:14.703770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 744/1482] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:23:14.708970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04045e7-cc1a-443f-bde2-fa534ed5c494 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:14.709401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04045e7-cc1a-443f-bde2-fa534ed5c494 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:14.709541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04045e7-cc1a-443f-bde2-fa534ed5c494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:14.774225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b04045e7-cc1a-443f-bde2-fa534ed5c494 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:23:14.775420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b04045e7-cc1a-443f-bde2-fa534ed5c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:14.821577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:14.871727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 739/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:23:14.907732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7526e3-6682-45f4-b20a-1f50895540c8 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:23:14.909781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7d7526e3-6682-45f4-b20a-1f50895540c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:14.933483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:15.011946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7526e3-6682-45f4-b20a-1f50895540c8 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:23:15.083703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d572709-869e-4515-ade2-2eeedc884800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:23:15.084303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572709-869e-4515-ade2-2eeedc884800 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:15.084584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572709-869e-4515-ade2-2eeedc884800 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:15.084854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d572709-869e-4515-ade2-2eeedc884800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:15.086484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7d572709-869e-4515-ade2-2eeedc884800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:15.158846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:15.193501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d572709-869e-4515-ade2-2eeedc884800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:23:15.194938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d572709-869e-4515-ade2-2eeedc884800 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:23:15.212255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 745/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:23:17.224551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e2e47-d477-4aa5-b4da-49c55595c4f5 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:17.225151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e2e47-d477-4aa5-b4da-49c55595c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:17.225151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e2e47-d477-4aa5-b4da-49c55595c4f5 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:17.226468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 740/1485] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:23:17.232255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22213c79-f6ac-4782-b629-12bb037d56c9 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:17.232716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22213c79-f6ac-4782-b629-12bb037d56c9 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:17.232849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22213c79-f6ac-4782-b629-12bb037d56c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:17.299121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-22213c79-f6ac-4782-b629-12bb037d56c9 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:23:17.300339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-22213c79-f6ac-4782-b629-12bb037d56c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:17.395973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 746/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:23:17.432692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e2e47-d477-4aa5-b4da-49c55595c4f5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:23:17.434255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-433e2e47-d477-4aa5-b4da-49c55595c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:17.536218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e2e47-d477-4aa5-b4da-49c55595c4f5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:23:17.606378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:17.608108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c42c4-2a03-4d3d-a2fc-e80588f94afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:23:17.608708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c42c4-2a03-4d3d-a2fc-e80588f94afd service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:17.609172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c42c4-2a03-4d3d-a2fc-e80588f94afd service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:17.609657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c42c4-2a03-4d3d-a2fc-e80588f94afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:17.611499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-382c42c4-2a03-4d3d-a2fc-e80588f94afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:17.721722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c42c4-2a03-4d3d-a2fc-e80588f94afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:23:17.723225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c42c4-2a03-4d3d-a2fc-e80588f94afd service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:23:17.742821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 741/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:23:19.829767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd929-814f-4a46-90ea-71327e9211a6 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:19.830329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd929-814f-4a46-90ea-71327e9211a6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:19.830329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd929-814f-4a46-90ea-71327e9211a6 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:19.831722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 747/1488] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:23:19.838364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70b18-7803-49be-8a9a-5c90c23e872b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:19.838799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70b18-7803-49be-8a9a-5c90c23e872b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:19.839018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70b18-7803-49be-8a9a-5c90c23e872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:19.907779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e0b70b18-7803-49be-8a9a-5c90c23e872b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:23:19.908976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e0b70b18-7803-49be-8a9a-5c90c23e872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:19.962085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:20.007261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 742/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:23:20.046914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fd929-814f-4a46-90ea-71327e9211a6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:23:20.048435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bd1fd929-814f-4a46-90ea-71327e9211a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:20.085658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:20.154659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fd929-814f-4a46-90ea-71327e9211a6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:23:20.240391 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4a028-4414-4eab-8b47-a5d824ff9c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:23:20.240987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a028-4414-4eab-8b47-a5d824ff9c8f service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:20.241266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a028-4414-4eab-8b47-a5d824ff9c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:20.241533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a028-4414-4eab-8b47-a5d824ff9c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:20.243147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a5d4a028-4414-4eab-8b47-a5d824ff9c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:20.323467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:20.352669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4a028-4414-4eab-8b47-a5d824ff9c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:23:20.354025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4a028-4414-4eab-8b47-a5d824ff9c8f service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:23:20.371895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 748/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:23:22.561490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae953-4e4e-47ea-8628-9f2a62ce3ac0 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:22.562101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae953-4e4e-47ea-8628-9f2a62ce3ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:22.562101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae953-4e4e-47ea-8628-9f2a62ce3ac0 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:22.563457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 743/1491] 10.222.0.23 () {54 vars in 927 bytes} [Mon Aug 8 00:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:23:22.568553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec6950-5488-40bf-9a05-f5da9f788546 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:22.568962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec6950-5488-40bf-9a05-f5da9f788546 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:22.569144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec6950-5488-40bf-9a05-f5da9f788546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:22.634786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-82ec6950-5488-40bf-9a05-f5da9f788546 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:23:22.635998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-82ec6950-5488-40bf-9a05-f5da9f788546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:22.731125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 749/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Aug 8 00:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:23:22.771607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ae953-4e4e-47ea-8628-9f2a62ce3ac0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:23:22.773137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8e3ae953-4e4e-47ea-8628-9f2a62ce3ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:22.877402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ae953-4e4e-47ea-8628-9f2a62ce3ac0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:23:22.949198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43f368-cf70-45f1-8777-3f9e94af34f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:23:22.949795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f368-cf70-45f1-8777-3f9e94af34f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:23:22.950090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f368-cf70-45f1-8777-3f9e94af34f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:23:22.950373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f368-cf70-45f1-8777-3f9e94af34f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:23:22.951961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8f43f368-cf70-45f1-8777-3f9e94af34f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:23:22.961337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:23.062382 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43f368-cf70-45f1-8777-3f9e94af34f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:23:23.063853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43f368-cf70-45f1-8777-3f9e94af34f4 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:23:23.082027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 744/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:23:32.729307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=82 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:23:33.079251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=50 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:47.433946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4076-7199-4fe5-b36b-4905fedbe390 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:47.434585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4076-7199-4fe5-b36b-4905fedbe390 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:47.434585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4076-7199-4fe5-b36b-4905fedbe390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:47.511014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-cabe4076-7199-4fe5-b36b-4905fedbe390 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:24:47.512225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cabe4076-7199-4fe5-b36b-4905fedbe390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:47.609882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 750/1494] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:24:47.618614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acac0-b468-46a0-8979-e600093035ff None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:47.619084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acac0-b468-46a0-8979-e600093035ff None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:47.619239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acac0-b468-46a0-8979-e600093035ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:47.695512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-210acac0-b468-46a0-8979-e600093035ff None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:24:47.696647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-210acac0-b468-46a0-8979-e600093035ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:47.791238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 745/1495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:24:47.795956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe4076-7199-4fe5-b36b-4905fedbe390 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:47.797185 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cabe4076-7199-4fe5-b36b-4905fedbe390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:47.809050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe4076-7199-4fe5-b36b-4905fedbe390 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:47.870730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:47.905421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:47.906032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:47.906343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:47.906620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:47.907770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:24:47.908865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:47.910687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING py.warnings [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:24:47.910687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: warnings.warn(msg) Aug 08 00:24:47.910687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: Aug 08 00:24:47.911581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:47.923029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 751/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:24:47.932002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acac0-b468-46a0-8979-e600093035ff None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:47.941137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acac0-b468-46a0-8979-e600093035ff None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:48.001991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:48.036063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:48.036659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:48.036941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:48.037217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:48.037829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:48.039598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING py.warnings [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:24:48.039598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: warnings.warn(msg) Aug 08 00:24:48.039598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: Aug 08 00:24:48.040786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:48.094736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 746/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:24:47 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:24:48.099425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:48.100995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:48.134306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500883a-0f4e-4134-a4b4-b1dc1689c316 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:48.226892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:48.227493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:48.227774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:48.228043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:48.228653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:48.229663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING py.warnings [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:24:48.229663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: warnings.warn(msg) Aug 08 00:24:48.229663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: Aug 08 00:24:48.230886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:48.279160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 752/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:24:48 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:24:48.283860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:48.285435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:48.347929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4cb9b-f54c-48d8-bb0d-926c7ba0ef0c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:48.429364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:48.440968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:48.441568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:48.441843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:48.442143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:48.442779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:48.443786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING py.warnings [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:24:48.443786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: warnings.warn(msg) Aug 08 00:24:48.443786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: Aug 08 00:24:48.444662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:48.457126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 747/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:24:48.461139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:48.462664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:48.474443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727498c7-bcbd-428e-9e00-db872e454973 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:48.498450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:48.567299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e986a-0370-41e6-96d0-6a4e516e69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:48.567825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e986a-0370-41e6-96d0-6a4e516e69e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:48.568098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e986a-0370-41e6-96d0-6a4e516e69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:48.568363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e986a-0370-41e6-96d0-6a4e516e69e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:48.568987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e986a-0370-41e6-96d0-6a4e516e69e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:48.569975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING py.warnings [None req-054e986a-0370-41e6-96d0-6a4e516e69e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:24:48.569975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: warnings.warn(msg) Aug 08 00:24:48.569975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: Aug 08 00:24:48.570884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e986a-0370-41e6-96d0-6a4e516e69e1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:48.583335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 753/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:24:48.587535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:48.589057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:48.622402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2419-ffd7-4b43-9f05-6a87021126a3 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:48.719009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa44b64-e63b-45d3-849f-10b0f8c00aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:48.719667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44b64-e63b-45d3-849f-10b0f8c00aad admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:48.719947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44b64-e63b-45d3-849f-10b0f8c00aad admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:48.720222 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44b64-e63b-45d3-849f-10b0f8c00aad admin admin] PATH_INFO: `/v3/projects/1c172b3bda924864b17cf789f5f35997/users/800c03141ac2485e95cc0ac3b8290ae3/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:48.741832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa44b64-e63b-45d3-849f-10b0f8c00aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c172b3bda924864b17cf789f5f35997, user_id=800c03141ac2485e95cc0ac3b8290ae3, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:48.742905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING py.warnings [None req-3fa44b64-e63b-45d3-849f-10b0f8c00aad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:24:48.742905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: warnings.warn(msg) Aug 08 00:24:48.742905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: Aug 08 00:24:48.744845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa44b64-e63b-45d3-849f-10b0f8c00aad admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:48.770257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 748/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:24:48 2022] PUT /identity/v3/projects/1c172b3bda924864b17cf789f5f35997/users/800c03141ac2485e95cc0ac3b8290ae3/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:24:48.782429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b383f-f318-4f7c-8e0a-9f17d7a34942 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:48.782712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b383f-f318-4f7c-8e0a-9f17d7a34942 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:48.782986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b383f-f318-4f7c-8e0a-9f17d7a34942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:48.839903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-564b383f-f318-4f7c-8e0a-9f17d7a34942 None None] MFA Rules not processed for user `800c03141ac2485e95cc0ac3b8290ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:24:48.841073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-564b383f-f318-4f7c-8e0a-9f17d7a34942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:48.917029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 754/1502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:24:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:24:48.930140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75858f43-33ca-4358-9a00-04a5758eaf85 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:48.930432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75858f43-33ca-4358-9a00-04a5758eaf85 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:48.930705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75858f43-33ca-4358-9a00-04a5758eaf85 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:48.932070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 749/1503] 10.222.0.23 () {54 vars in 964 bytes} [Mon Aug 8 00:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:24:48.936761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dfd80-fabb-4dbb-ab27-b58fd51c4ca2 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:48.937116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dfd80-fabb-4dbb-ab27-b58fd51c4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:48.937335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dfd80-fabb-4dbb-ab27-b58fd51c4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:48.969231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:49.012895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-1d6dfd80-fabb-4dbb-ab27-b58fd51c4ca2 None None] MFA Rules not processed for user `064dcac38bd1416f93bb1b763cb89f84`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:24:49.014113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1d6dfd80-fabb-4dbb-ab27-b58fd51c4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:49.090137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 755/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Aug 8 00:24:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:24:49.097952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75858f43-33ca-4358-9a00-04a5758eaf85 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:49.099486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-75858f43-33ca-4358-9a00-04a5758eaf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:49.149249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:49.203442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75858f43-33ca-4358-9a00-04a5758eaf85 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:49.276004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:49.276603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:49.276877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:49.277146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:49.278745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:49.375675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:49.377027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:49.380468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:49.394796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 750/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:24:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:24:49.443052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ceaa-367e-4528-911f-2b3d80a3aa26 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:49.443350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ceaa-367e-4528-911f-2b3d80a3aa26 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:49.443626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ceaa-367e-4528-911f-2b3d80a3aa26 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:49.444923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 756/1506] 10.222.0.23 () {52 vars in 830 bytes} [Mon Aug 8 00:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:24:49.448482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:49.449690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:49.548420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0545-cf8b-4052-a0fc-b216a84df95e service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:49.641832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:49.643400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:49.643554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:49.643833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] PATH_INFO: `/v3/users/800c03141ac2485e95cc0ac3b8290ae3` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:49.655724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800c03141ac2485e95cc0ac3b8290ae3)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:49.656746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING py.warnings [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:24:49.656746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: warnings.warn(msg) Aug 08 00:24:49.656746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: Aug 08 00:24:49.657947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:49.667487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:49.722127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800c03141ac2485e95cc0ac3b8290ae3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:49.731375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800c03141ac2485e95cc0ac3b8290ae3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:49.731799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800c03141ac2485e95cc0ac3b8290ae3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:49.745458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800c03141ac2485e95cc0ac3b8290ae3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:49.768147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800c03141ac2485e95cc0ac3b8290ae3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:49.773884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 751/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:24:49 2022] DELETE /identity/v3/users/800c03141ac2485e95cc0ac3b8290ae3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:24:49.778307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ceb5c-7bc1-4837-86f6-f78989767fbc None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:49.778769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ceb5c-7bc1-4837-86f6-f78989767fbc None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:49.778877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ceb5c-7bc1-4837-86f6-f78989767fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:49.837858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-435ceb5c-7bc1-4837-86f6-f78989767fbc None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:24:49.839113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-435ceb5c-7bc1-4837-86f6-f78989767fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:49.917388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:49.930770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 757/1508] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:24:49.941585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:49.942920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:50.040949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19bbaf-bfa1-408d-932d-a6052c810f16 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:50.096326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:24:50.117315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046df01d-ae0c-456d-b96f-f8f397c9b903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:50.117924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046df01d-ae0c-456d-b96f-f8f397c9b903 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:50.118420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046df01d-ae0c-456d-b96f-f8f397c9b903 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:50.118565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046df01d-ae0c-456d-b96f-f8f397c9b903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:50.120098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-046df01d-ae0c-456d-b96f-f8f397c9b903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:50.226573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046df01d-ae0c-456d-b96f-f8f397c9b903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:50.228018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046df01d-ae0c-456d-b96f-f8f397c9b903 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:50.246694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 752/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:24:50.565996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ceb5c-7bc1-4837-86f6-f78989767fbc None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:24:50.567253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-435ceb5c-7bc1-4837-86f6-f78989767fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:24:50.578733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ceb5c-7bc1-4837-86f6-f78989767fbc None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:24:50.681311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:24:50.681944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:24:50.682262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:24:50.682539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] PATH_INFO: `/v3/projects/1c172b3bda924864b17cf789f5f35997` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:24:50.692268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c172b3bda924864b17cf789f5f35997)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:24:50.693299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING py.warnings [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:24:50.693299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: warnings.warn(msg) Aug 08 00:24:50.693299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: Aug 08 00:24:50.694538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:24:50.752171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c172b3bda924864b17cf789f5f35997', 'request_id': 'req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:50.757966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c172b3bda924864b17cf789f5f35997', 'request_id': 'req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:50.771483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c172b3bda924864b17cf789f5f35997', 'request_id': 'req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:50.796800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] The token cache is being invalidate because project 1c172b3bda924864b17cf789f5f35997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:24:50.797394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:50.797500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926ecd8e-6e30-43a7-bb69-cffc1cd1e65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:24:50.798917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 758/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:24:50 2022] DELETE /identity/v3/projects/1c172b3bda924864b17cf789f5f35997 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:25:00.244434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=62 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:00.794740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:26:28.935348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56abcc-25ed-490a-a9fd-67cfceef165f None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:28.935934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56abcc-25ed-490a-a9fd-67cfceef165f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:28.935934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56abcc-25ed-490a-a9fd-67cfceef165f None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:28.937248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:28.941923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46ca82-82b9-4add-b24d-5b1777b028f1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:28.942353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46ca82-82b9-4add-b24d-5b1777b028f1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:28.942507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46ca82-82b9-4add-b24d-5b1777b028f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:29.020491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-fa46ca82-82b9-4add-b24d-5b1777b028f1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:29.021680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fa46ca82-82b9-4add-b24d-5b1777b028f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:29.132240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:26:29.286560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56abcc-25ed-490a-a9fd-67cfceef165f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:29.288693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8b56abcc-25ed-490a-a9fd-67cfceef165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:29.406307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56abcc-25ed-490a-a9fd-67cfceef165f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:29.411730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18897bf2-2cf5-4c3d-824c-cf226c0f3591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:29.412334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897bf2-2cf5-4c3d-824c-cf226c0f3591 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:29.412620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897bf2-2cf5-4c3d-824c-cf226c0f3591 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:29.412898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897bf2-2cf5-4c3d-824c-cf226c0f3591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:29.421568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18897bf2-2cf5-4c3d-824c-cf226c0f3591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:29.423193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18897bf2-2cf5-4c3d-824c-cf226c0f3591 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:29.432445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 754/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:30.264587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf0c6-0648-4b23-85a0-de1fe32770ba None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:30.265140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf0c6-0648-4b23-85a0-de1fe32770ba None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:30.265140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf0c6-0648-4b23-85a0-de1fe32770ba None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:30.266550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:30.271697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c06741-bce1-4a38-8951-f4ff1b88ba01 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:30.272100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c06741-bce1-4a38-8951-f4ff1b88ba01 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:30.272297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c06741-bce1-4a38-8951-f4ff1b88ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:30.291957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-95c06741-bce1-4a38-8951-f4ff1b88ba01 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:30.293651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-95c06741-bce1-4a38-8951-f4ff1b88ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:30.301976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:26:30.455684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cf0c6-0648-4b23-85a0-de1fe32770ba None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:30.464680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33a5cc-659f-4a61-85b1-920cf2cb526b None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:30.464964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33a5cc-659f-4a61-85b1-920cf2cb526b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:30.465234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33a5cc-659f-4a61-85b1-920cf2cb526b None None] PATH_INFO: `/v3` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:30.466553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 756/1516] 10.222.0.26 () {54 vars in 925 bytes} [Mon Aug 8 00:26:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:26:30.470644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cf0c6-0648-4b23-85a0-de1fe32770ba None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:30.473519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acd05-a146-4ec3-8c90-7740ddb4ed47 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:30.473809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acd05-a146-4ec3-8c90-7740ddb4ed47 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:30.474097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acd05-a146-4ec3-8c90-7740ddb4ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:30.476158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb74246-0651-4e52-a3cc-4249d28633a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:30.476748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74246-0651-4e52-a3cc-4249d28633a7 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:30.477026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74246-0651-4e52-a3cc-4249d28633a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:30.477296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74246-0651-4e52-a3cc-4249d28633a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:30.485808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb74246-0651-4e52-a3cc-4249d28633a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:30.487422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb74246-0651-4e52-a3cc-4249d28633a7 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:30.496988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 761/1517] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:30.536614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c41acd05-a146-4ec3-8c90-7740ddb4ed47 None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:30.537881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c41acd05-a146-4ec3-8c90-7740ddb4ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:30.595408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:26:30.615024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 757/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Aug 8 00:26:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:26:39.540650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f313-524b-4f63-b4d4-8fc52a95c86f None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:39.541197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f313-524b-4f63-b4d4-8fc52a95c86f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:39.541197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f313-524b-4f63-b4d4-8fc52a95c86f None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:39.542489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 762/1519] 10.222.0.23 () {54 vars in 961 bytes} [Mon Aug 8 00:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:39.547656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a58da-4082-4ea9-accb-5b107a6a4c11 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:39.548108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a58da-4082-4ea9-accb-5b107a6a4c11 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:39.548215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a58da-4082-4ea9-accb-5b107a6a4c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:39.567218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c21a58da-4082-4ea9-accb-5b107a6a4c11 None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:39.568407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c21a58da-4082-4ea9-accb-5b107a6a4c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:39.577424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 758/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Aug 8 00:26:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:26:39.584928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f313-524b-4f63-b4d4-8fc52a95c86f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:39.598803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f313-524b-4f63-b4d4-8fc52a95c86f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:39.603923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f736d-2465-4eae-bd15-7ed7ee0b3b91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:39.604511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f736d-2465-4eae-bd15-7ed7ee0b3b91 service placement] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:39.604794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f736d-2465-4eae-bd15-7ed7ee0b3b91 service placement] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:39.605067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f736d-2465-4eae-bd15-7ed7ee0b3b91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:39.613284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f736d-2465-4eae-bd15-7ed7ee0b3b91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:39.614900 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f736d-2465-4eae-bd15-7ed7ee0b3b91 service placement] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:39.624828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 763/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:41.723911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593cf09-87d8-4bb9-b7f4-4c14f91c55fc None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:41.724476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593cf09-87d8-4bb9-b7f4-4c14f91c55fc None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:41.724476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593cf09-87d8-4bb9-b7f4-4c14f91c55fc None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:41.725811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:41.730663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3c66d-df49-49f7-ba20-80cd9a1764ba None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:41.731054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3c66d-df49-49f7-ba20-80cd9a1764ba None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:41.731221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3c66d-df49-49f7-ba20-80cd9a1764ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:41.751418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e2d3c66d-df49-49f7-ba20-80cd9a1764ba None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:41.752645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e2d3c66d-df49-49f7-ba20-80cd9a1764ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:41.760474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:26:41.929608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593cf09-87d8-4bb9-b7f4-4c14f91c55fc None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:41.944239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593cf09-87d8-4bb9-b7f4-4c14f91c55fc None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:41.949685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69151-bb1b-4337-85c5-0e9e8959259a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:41.950302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69151-bb1b-4337-85c5-0e9e8959259a service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:41.950586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69151-bb1b-4337-85c5-0e9e8959259a service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:41.950865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69151-bb1b-4337-85c5-0e9e8959259a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:41.958882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf69151-bb1b-4337-85c5-0e9e8959259a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:41.960476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf69151-bb1b-4337-85c5-0e9e8959259a service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:41.970334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 760/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:42.785131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3498454-b547-41a4-877d-5c0b64408594 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:42.785647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3498454-b547-41a4-877d-5c0b64408594 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:42.785751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3498454-b547-41a4-877d-5c0b64408594 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:42.787064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 00:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:42.791722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49eb7e-191d-47ec-9937-95b7413da9c2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:42.792127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49eb7e-191d-47ec-9937-95b7413da9c2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:42.792272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49eb7e-191d-47ec-9937-95b7413da9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:42.812435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-6d49eb7e-191d-47ec-9937-95b7413da9c2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:42.813627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6d49eb7e-191d-47ec-9937-95b7413da9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:42.821412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 00:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:26:42.975877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3498454-b547-41a4-877d-5c0b64408594 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:42.990646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3498454-b547-41a4-877d-5c0b64408594 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:42.996176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3622edd-e872-4114-af53-fc4098f2d291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:42.996786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3622edd-e872-4114-af53-fc4098f2d291 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:42.997047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3622edd-e872-4114-af53-fc4098f2d291 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:42.997326 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3622edd-e872-4114-af53-fc4098f2d291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:43.006052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3622edd-e872-4114-af53-fc4098f2d291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:43.007647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3622edd-e872-4114-af53-fc4098f2d291 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:43.017131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 766/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:46.861914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24671-581b-4434-bcd3-50014ecc05d6 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:46.862363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24671-581b-4434-bcd3-50014ecc05d6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:46.862467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24671-581b-4434-bcd3-50014ecc05d6 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:46.863811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:46.868840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5065-892f-43d6-9456-1519638c39a9 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:46.869273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5065-892f-43d6-9456-1519638c39a9 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:46.869381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5065-892f-43d6-9456-1519638c39a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:46.888310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-1ecd5065-892f-43d6-9456-1519638c39a9 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:46.889527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1ecd5065-892f-43d6-9456-1519638c39a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:46.898205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:26:46.969879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f24671-581b-4434-bcd3-50014ecc05d6 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:46.971659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-27f24671-581b-4434-bcd3-50014ecc05d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:47.048870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f24671-581b-4434-bcd3-50014ecc05d6 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:47.052472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c551728-9d3e-45aa-8168-cae1c0da44e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:47.053071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c551728-9d3e-45aa-8168-cae1c0da44e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:47.053353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c551728-9d3e-45aa-8168-cae1c0da44e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:47.053628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c551728-9d3e-45aa-8168-cae1c0da44e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:47.062389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c551728-9d3e-45aa-8168-cae1c0da44e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:47.064316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c551728-9d3e-45aa-8168-cae1c0da44e6 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:47.073791 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 763/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:49.072897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99cb4b-fc1c-47e6-8d32-cf34499af557 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:49.073467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99cb4b-fc1c-47e6-8d32-cf34499af557 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:49.073467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99cb4b-fc1c-47e6-8d32-cf34499af557 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:49.074841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:49.079883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c3a5c-b959-4d78-adda-1ea4a7590ed6 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:49.080318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c3a5c-b959-4d78-adda-1ea4a7590ed6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:49.080427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c3a5c-b959-4d78-adda-1ea4a7590ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:49.099487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-1b1c3a5c-b959-4d78-adda-1ea4a7590ed6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:49.100664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1b1c3a5c-b959-4d78-adda-1ea4a7590ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:49.108256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:26:49.144819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99cb4b-fc1c-47e6-8d32-cf34499af557 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:49.155595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99cb4b-fc1c-47e6-8d32-cf34499af557 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:49.159411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d972ce-831b-4168-abcb-883ed06b3075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:49.159994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d972ce-831b-4168-abcb-883ed06b3075 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:49.160272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d972ce-831b-4168-abcb-883ed06b3075 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:49.160542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d972ce-831b-4168-abcb-883ed06b3075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:49.169238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d972ce-831b-4168-abcb-883ed06b3075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:49.170680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d972ce-831b-4168-abcb-883ed06b3075 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:49.180354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 769/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:52.606909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e8f4-4995-4037-9978-f9306a14a038 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:52.607518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e8f4-4995-4037-9978-f9306a14a038 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:52.607518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e8f4-4995-4037-9978-f9306a14a038 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:52.608782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:52.614581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f672f3-bebe-47d7-86f9-e71f891f0dbb None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:52.615096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f672f3-bebe-47d7-86f9-e71f891f0dbb None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:52.615207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f672f3-bebe-47d7-86f9-e71f891f0dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:52.622685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:26:52.635064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d4f672f3-bebe-47d7-86f9-e71f891f0dbb None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:52.636282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d4f672f3-bebe-47d7-86f9-e71f891f0dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:52.644212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:26:52.945292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75e8f4-4995-4037-9978-f9306a14a038 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:52.946959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7e75e8f4-4995-4037-9978-f9306a14a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:53.024441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75e8f4-4995-4037-9978-f9306a14a038 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:53.028710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe4ee1-baed-48e4-91e2-4f76f894d0be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:53.029349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe4ee1-baed-48e4-91e2-4f76f894d0be service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:53.029630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe4ee1-baed-48e4-91e2-4f76f894d0be service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:53.029902 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe4ee1-baed-48e4-91e2-4f76f894d0be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:53.040077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe4ee1-baed-48e4-91e2-4f76f894d0be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:53.041507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe4ee1-baed-48e4-91e2-4f76f894d0be service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:53.050755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 766/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:55.047484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23d0c-18a8-44e7-8e74-c475d8435280 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:55.048046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23d0c-18a8-44e7-8e74-c475d8435280 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:55.048046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23d0c-18a8-44e7-8e74-c475d8435280 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:55.049363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 00:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:26:55.054416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e2f4-82d2-48e8-8713-03ffa3068205 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:55.054808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e2f4-82d2-48e8-8713-03ffa3068205 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:55.054999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e2f4-82d2-48e8-8713-03ffa3068205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:55.074774 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-2591e2f4-82d2-48e8-8713-03ffa3068205 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:26:55.075988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-2591e2f4-82d2-48e8-8713-03ffa3068205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:55.084466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:26:55.385080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c23d0c-18a8-44e7-8e74-c475d8435280 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:26:55.386762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-02c23d0c-18a8-44e7-8e74-c475d8435280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:26:55.400013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c23d0c-18a8-44e7-8e74-c475d8435280 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:26:55.403498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d491d8-2301-4967-a553-543e4d1feebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:26:55.404083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d491d8-2301-4967-a553-543e4d1feebf service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:26:55.404357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d491d8-2301-4967-a553-543e4d1feebf service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:26:55.404625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d491d8-2301-4967-a553-543e4d1feebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:26:55.413948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d491d8-2301-4967-a553-543e4d1feebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:26:55.415398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d491d8-2301-4967-a553-543e4d1feebf service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:26:55.426641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 772/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:27:05.069736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:27:05.421118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=8 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:29.515796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7398d-c747-4c5a-9c7b-cf2f12a565ca None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.517069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7398d-c747-4c5a-9c7b-cf2f12a565ca None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.517581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7398d-c747-4c5a-9c7b-cf2f12a565ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.552788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-4aa7398d-c747-4c5a-9c7b-cf2f12a565ca None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:29.554829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4aa7398d-c747-4c5a-9c7b-cf2f12a565ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:29.571693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 768/1540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:29.580912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0383-d3e9-4cac-962b-909c58a4ec12 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.581509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0383-d3e9-4cac-962b-909c58a4ec12 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.581509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0383-d3e9-4cac-962b-909c58a4ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.601932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9f184-6acb-461e-84ac-f8c1258f0c69 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.602316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9f184-6acb-461e-84ac-f8c1258f0c69 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.602507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9f184-6acb-461e-84ac-f8c1258f0c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.619512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-284e0383-d3e9-4cac-962b-909c58a4ec12 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:29.621344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-284e0383-d3e9-4cac-962b-909c58a4ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:29.628845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b9c9f184-6acb-461e-84ac-f8c1258f0c69 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:29.630334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b9c9f184-6acb-461e-84ac-f8c1258f0c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:29.644091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 769/1541] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:28:29.644600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 773/1542] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:29.649655 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9f184-6acb-461e-84ac-f8c1258f0c69 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:29.653537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cca04-e458-4426-9079-dffc8f1b9eec None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.654343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cca04-e458-4426-9079-dffc8f1b9eec None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.654858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cca04-e458-4426-9079-dffc8f1b9eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.660203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9f184-6acb-461e-84ac-f8c1258f0c69 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:29.670278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3473c89-e3a8-4c0e-9d83-e609c92cc963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:29.670904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473c89-e3a8-4c0e-9d83-e609c92cc963 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.671186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473c89-e3a8-4c0e-9d83-e609c92cc963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.671460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473c89-e3a8-4c0e-9d83-e609c92cc963 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.672118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3473c89-e3a8-4c0e-9d83-e609c92cc963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:29.672426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3473c89-e3a8-4c0e-9d83-e609c92cc963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:29.673573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING py.warnings [None req-a3473c89-e3a8-4c0e-9d83-e609c92cc963 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:28:29.673573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: warnings.warn(msg) Aug 08 00:28:29.673573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: Aug 08 00:28:29.674491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3473c89-e3a8-4c0e-9d83-e609c92cc963 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:29.692156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 770/1543] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:29.696369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-0e9cca04-e458-4426-9079-dffc8f1b9eec None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:29.698036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0e9cca04-e458-4426-9079-dffc8f1b9eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:29.699511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023ff0f-59d7-4829-ae9b-540081c39aff None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.699803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023ff0f-59d7-4829-ae9b-540081c39aff None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.700088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023ff0f-59d7-4829-ae9b-540081c39aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.728201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c023ff0f-59d7-4829-ae9b-540081c39aff None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:29.729514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c023ff0f-59d7-4829-ae9b-540081c39aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:29.729848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 774/1544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:29.730912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cca04-e458-4426-9079-dffc8f1b9eec None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:29.743306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 771/1545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:29.744183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023ff0f-59d7-4829-ae9b-540081c39aff None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:29.760796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cca04-e458-4426-9079-dffc8f1b9eec None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:29.763128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023ff0f-59d7-4829-ae9b-540081c39aff None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:29.768926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba3720-317b-4a8c-85a2-6f7adfa163d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:29.769477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3720-317b-4a8c-85a2-6f7adfa163d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.769865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3720-317b-4a8c-85a2-6f7adfa163d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.770194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3720-317b-4a8c-85a2-6f7adfa163d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.771360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba3720-317b-4a8c-85a2-6f7adfa163d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:29.771668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba3720-317b-4a8c-85a2-6f7adfa163d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:29.772673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768735a7-f558-4ecb-9a78-5005da8d8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:29.773280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba3720-317b-4a8c-85a2-6f7adfa163d7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:29.773787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768735a7-f558-4ecb-9a78-5005da8d8cdc admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.774332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768735a7-f558-4ecb-9a78-5005da8d8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.774831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768735a7-f558-4ecb-9a78-5005da8d8cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.775679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768735a7-f558-4ecb-9a78-5005da8d8cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:29.777019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING py.warnings [None req-768735a7-f558-4ecb-9a78-5005da8d8cdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:28:29.777019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: warnings.warn(msg) Aug 08 00:28:29.777019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: Aug 08 00:28:29.778660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768735a7-f558-4ecb-9a78-5005da8d8cdc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:29.796778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 772/1546] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:29.798098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8524bf-934a-483d-8180-c92faa6bb827 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.798404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8524bf-934a-483d-8180-c92faa6bb827 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.798685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8524bf-934a-483d-8180-c92faa6bb827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.838784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-df8524bf-934a-483d-8180-c92faa6bb827 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:29.840056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-df8524bf-934a-483d-8180-c92faa6bb827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:29.853748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 773/1547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:29.854510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8524bf-934a-483d-8180-c92faa6bb827 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:29.865569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 775/1548] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:29.865899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8524bf-934a-483d-8180-c92faa6bb827 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:29.867536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89567-4bc0-4c6d-b44f-4cbc5506ff7a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.868058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89567-4bc0-4c6d-b44f-4cbc5506ff7a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.868572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89567-4bc0-4c6d-b44f-4cbc5506ff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.906632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-dca89567-4bc0-4c6d-b44f-4cbc5506ff7a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:29.919349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-dca89567-4bc0-4c6d-b44f-4cbc5506ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:29.970630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568dc95-a0f8-47c7-9713-03745fd9931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:29.971454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568dc95-a0f8-47c7-9713-03745fd9931a admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:29.971736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568dc95-a0f8-47c7-9713-03745fd9931a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:29.972006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568dc95-a0f8-47c7-9713-03745fd9931a admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:29.972627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568dc95-a0f8-47c7-9713-03745fd9931a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:29.975429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568dc95-a0f8-47c7-9713-03745fd9931a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.003963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 776/1549] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.006102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b8fb6-5928-4bc8-ad5d-0dbc57d65922 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.006398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b8fb6-5928-4bc8-ad5d-0dbc57d65922 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.006672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b8fb6-5928-4bc8-ad5d-0dbc57d65922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.012168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 774/1550] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:29 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.013028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568dc95-a0f8-47c7-9713-03745fd9931a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.027067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-aa6b8fb6-5928-4bc8-ad5d-0dbc57d65922 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.028182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-aa6b8fb6-5928-4bc8-ad5d-0dbc57d65922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.075630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568dc95-a0f8-47c7-9713-03745fd9931a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.080421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc17c15-74ef-419c-8346-7b2ba9affce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.081020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc17c15-74ef-419c-8346-7b2ba9affce3 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.081314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc17c15-74ef-419c-8346-7b2ba9affce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.081570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc17c15-74ef-419c-8346-7b2ba9affce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.082273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc17c15-74ef-419c-8346-7b2ba9affce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:30.082575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc17c15-74ef-419c-8346-7b2ba9affce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.084255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc17c15-74ef-419c-8346-7b2ba9affce3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.086907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 777/1551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.087727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b8fb6-5928-4bc8-ad5d-0dbc57d65922 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.103332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 775/1552] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:30.103332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2ff0-9a5f-4d72-a16e-2750bd21f285 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.103332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2ff0-9a5f-4d72-a16e-2750bd21f285 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.103332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2ff0-9a5f-4d72-a16e-2750bd21f285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.109287 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b8fb6-5928-4bc8-ad5d-0dbc57d65922 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.114352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9c7d-4ff0-42d8-9f3b-fa7adc5485cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.114996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9c7d-4ff0-42d8-9f3b-fa7adc5485cb admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.115303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9c7d-4ff0-42d8-9f3b-fa7adc5485cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.115573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9c7d-4ff0-42d8-9f3b-fa7adc5485cb admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.116188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9c7d-4ff0-42d8-9f3b-fa7adc5485cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.116897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c6ee2ff0-9a5f-4d72-a16e-2750bd21f285 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.118110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c6ee2ff0-9a5f-4d72-a16e-2750bd21f285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.118225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9c7d-4ff0-42d8-9f3b-fa7adc5485cb admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.126234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 776/1553] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.127487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ceace-96fe-4586-9408-48ffecfebe33 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.127780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ceace-96fe-4586-9408-48ffecfebe33 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.128061 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ceace-96fe-4586-9408-48ffecfebe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.145083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 778/1554] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/users => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.146427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb886-1376-4fa2-ad35-5287349ba7a5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.146718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb886-1376-4fa2-ad35-5287349ba7a5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.146997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb886-1376-4fa2-ad35-5287349ba7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.151928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-287ceace-96fe-4586-9408-48ffecfebe33 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.153347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-287ceace-96fe-4586-9408-48ffecfebe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.161789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 777/1555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.169270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7438fa-a838-407e-a83a-f77d5e634950 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.169270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7438fa-a838-407e-a83a-f77d5e634950 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.169270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7438fa-a838-407e-a83a-f77d5e634950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.169543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-eb7cb886-1376-4fa2-ad35-5287349ba7a5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.169543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-eb7cb886-1376-4fa2-ad35-5287349ba7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.175841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 779/1556] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.176736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb886-1376-4fa2-ad35-5287349ba7a5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.183530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7c7438fa-a838-407e-a83a-f77d5e634950 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.184733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7c7438fa-a838-407e-a83a-f77d5e634950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.187840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb886-1376-4fa2-ad35-5287349ba7a5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.193603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185986f4-5883-40d1-99fb-a78d94466c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.193859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 778/1557] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.195090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734410d3-6518-44fa-9a04-650c5bee805b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.195358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734410d3-6518-44fa-9a04-650c5bee805b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.195632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734410d3-6518-44fa-9a04-650c5bee805b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.197990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185986f4-5883-40d1-99fb-a78d94466c2c admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.198351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185986f4-5883-40d1-99fb-a78d94466c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.198641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185986f4-5883-40d1-99fb-a78d94466c2c admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.199266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185986f4-5883-40d1-99fb-a78d94466c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.201281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185986f4-5883-40d1-99fb-a78d94466c2c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.209458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:30.215595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-734410d3-6518-44fa-9a04-650c5bee805b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.218102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-734410d3-6518-44fa-9a04-650c5bee805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.226607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 780/1558] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.227475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 779/1559] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.227619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185986f4-5883-40d1-99fb-a78d94466c2c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.228641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93c3a-8d2e-4317-9f3c-bc31af2e331d None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.228992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93c3a-8d2e-4317-9f3c-bc31af2e331d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.229337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93c3a-8d2e-4317-9f3c-bc31af2e331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.242915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185986f4-5883-40d1-99fb-a78d94466c2c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.247631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f1db8-887b-4dc6-be12-8844c23de655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.248228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f1db8-887b-4dc6-be12-8844c23de655 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.248508 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f1db8-887b-4dc6-be12-8844c23de655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.248787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f1db8-887b-4dc6-be12-8844c23de655 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.248989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-1ce93c3a-8d2e-4317-9f3c-bc31af2e331d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.249401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f1db8-887b-4dc6-be12-8844c23de655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.250217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1ce93c3a-8d2e-4317-9f3c-bc31af2e331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.251327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f1db8-887b-4dc6-be12-8844c23de655 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.258645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 780/1560] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.259427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93c3a-8d2e-4317-9f3c-bc31af2e331d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.268769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93c3a-8d2e-4317-9f3c-bc31af2e331d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.270392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:30.273952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac894fc-792f-42e5-9e90-dff0159ca250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.274660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac894fc-792f-42e5-9e90-dff0159ca250 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.274932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac894fc-792f-42e5-9e90-dff0159ca250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.275250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac894fc-792f-42e5-9e90-dff0159ca250 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.276004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac894fc-792f-42e5-9e90-dff0159ca250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.278096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac894fc-792f-42e5-9e90-dff0159ca250 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.289192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 781/1561] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.289192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60f7e-627f-4093-92e3-4021fb646f27 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.289192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60f7e-627f-4093-92e3-4021fb646f27 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.289192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60f7e-627f-4093-92e3-4021fb646f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.289595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 781/1562] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:30.290195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6757b-6503-4618-b9d8-df60b527f93b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.290487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6757b-6503-4618-b9d8-df60b527f93b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.290767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6757b-6503-4618-b9d8-df60b527f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.308675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-57f60f7e-627f-4093-92e3-4021fb646f27 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.309590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-50c6757b-6503-4618-b9d8-df60b527f93b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:30.309884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-57f60f7e-627f-4093-92e3-4021fb646f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.310839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-50c6757b-6503-4618-b9d8-df60b527f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:30.369939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 782/1563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.371065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60f7e-627f-4093-92e3-4021fb646f27 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.375803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 782/1564] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:30.376998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6757b-6503-4618-b9d8-df60b527f93b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.384469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60f7e-627f-4093-92e3-4021fb646f27 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.388469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6757b-6503-4618-b9d8-df60b527f93b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.389301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.389902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.390227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.390502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.391202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:30.391519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.393386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.393504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e945d-c20d-4dfd-9617-ab26ddad6e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.394021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e945d-c20d-4dfd-9617-ab26ddad6e24 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.394333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e945d-c20d-4dfd-9617-ab26ddad6e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.394633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e945d-c20d-4dfd-9617-ab26ddad6e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.395306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e945d-c20d-4dfd-9617-ab26ddad6e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.397062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e945d-c20d-4dfd-9617-ab26ddad6e24 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.405418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 783/1565] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:30.406533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.406911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 783/1566] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:30.407703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e945d-c20d-4dfd-9617-ab26ddad6e24 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.417435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e945d-c20d-4dfd-9617-ab26ddad6e24 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.422158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.422613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947de319-d627-48e1-b74e-785b11210adc admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.422723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.423047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.423316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.423948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:30.424248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.425840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.427871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.428474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.428761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.429038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.429667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:30.429975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.431570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.438780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 784/1567] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:30.439550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.445952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 784/1568] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:30.446920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.455050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9142c31-58f4-4396-a244-1c1c98f6e12b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.456534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294098f4-74a4-4f9f-9461-9af8d62a6190 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.460083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.460665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.460939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.461209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.461818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.461926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a04a6c-846c-474d-ac50-abf8d4a83a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.462585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a04a6c-846c-474d-ac50-abf8d4a83a12 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.462859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING py.warnings [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:28:30.462859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: warnings.warn(msg) Aug 08 00:28:30.462859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: Aug 08 00:28:30.463142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a04a6c-846c-474d-ac50-abf8d4a83a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.463477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a04a6c-846c-474d-ac50-abf8d4a83a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.464046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.464259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a04a6c-846c-474d-ac50-abf8d4a83a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.465896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a04a6c-846c-474d-ac50-abf8d4a83a12 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.475965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 785/1569] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:30.476855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a04a6c-846c-474d-ac50-abf8d4a83a12 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.488560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 785/1570] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/users => generated 296 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.488560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.488824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a04a6c-846c-474d-ac50-abf8d4a83a12 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.492917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.493507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.493797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.494150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.494757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:30.495067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.496538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02aad1-6739-47dc-affd-0b6e5599db7e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.496658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.501101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.501676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.501955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.502251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.502880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:30.503179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.504749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.509959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 786/1571] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:30.510795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.523447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 786/1572] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:30.523447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.524075 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806f46b-3715-437f-9c35-f00c0de1c0e9 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.527226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff46f1-6f2e-4603-9745-d2fca2515435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.527822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff46f1-6f2e-4603-9745-d2fca2515435 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.528154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff46f1-6f2e-4603-9745-d2fca2515435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.528991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff46f1-6f2e-4603-9745-d2fca2515435 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.529906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff46f1-6f2e-4603-9745-d2fca2515435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.532013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff46f1-6f2e-4603-9745-d2fca2515435 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.533210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d74bb-194a-48b3-ace1-ae382fbba0a1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.538511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bdc0f-c0ec-4181-aa1f-7b2d84e61560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.539096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdc0f-c0ec-4181-aa1f-7b2d84e61560 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.539379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdc0f-c0ec-4181-aa1f-7b2d84e61560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.539649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdc0f-c0ec-4181-aa1f-7b2d84e61560 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.540263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bdc0f-c0ec-4181-aa1f-7b2d84e61560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.542176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bdc0f-c0ec-4181-aa1f-7b2d84e61560 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.542522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 787/1573] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:30.543353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff46f1-6f2e-4603-9745-d2fca2515435 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.553537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff46f1-6f2e-4603-9745-d2fca2515435 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.558131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d3294-4830-4a1d-a8f7-41c47e349203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.558709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d3294-4830-4a1d-a8f7-41c47e349203 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.558992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d3294-4830-4a1d-a8f7-41c47e349203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.559297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d3294-4830-4a1d-a8f7-41c47e349203 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.560386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d3294-4830-4a1d-a8f7-41c47e349203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.562578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d3294-4830-4a1d-a8f7-41c47e349203 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.570130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 787/1574] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.570995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bdc0f-c0ec-4181-aa1f-7b2d84e61560 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.593848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 788/1575] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.593848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d3294-4830-4a1d-a8f7-41c47e349203 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.639798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bdc0f-c0ec-4181-aa1f-7b2d84e61560 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.648906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:30.653060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d3294-4830-4a1d-a8f7-41c47e349203 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.657810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.658631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.658919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.659229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] PATH_INFO: `/v3/projects/efbc580e28f54efea79658337149d294/users/61fca635a71c4d73af5225a428bfabdd/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.673541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbc580e28f54efea79658337149d294, user_id=61fca635a71c4d73af5225a428bfabdd, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.674592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING py.warnings [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:28:30.674592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: warnings.warn(msg) Aug 08 00:28:30.674592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: Aug 08 00:28:30.676503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.679416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:30.691588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 789/1576] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:30 2022] PUT /identity/v3/projects/efbc580e28f54efea79658337149d294/users/61fca635a71c4d73af5225a428bfabdd/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:30.692373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.703052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013133d7-b7f6-4fd7-ac32-2df579a2c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.703657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013133d7-b7f6-4fd7-ac32-2df579a2c040 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.703932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013133d7-b7f6-4fd7-ac32-2df579a2c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.704199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013133d7-b7f6-4fd7-ac32-2df579a2c040 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.704811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013133d7-b7f6-4fd7-ac32-2df579a2c040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.706750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013133d7-b7f6-4fd7-ac32-2df579a2c040 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.734147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 788/1577] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.737523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013133d7-b7f6-4fd7-ac32-2df579a2c040 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.756217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72552012-59ad-4554-8d22-16c67fdb100d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.799565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013133d7-b7f6-4fd7-ac32-2df579a2c040 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.804646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614addce-630e-4851-adf8-60f5feb772ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.805278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614addce-630e-4851-adf8-60f5feb772ae admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.805555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614addce-630e-4851-adf8-60f5feb772ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.805829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614addce-630e-4851-adf8-60f5feb772ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.806470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614addce-630e-4851-adf8-60f5feb772ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.808367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614addce-630e-4851-adf8-60f5feb772ae admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.811509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edc3f8-5551-4267-9fce-27a5704c668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.812141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc3f8-5551-4267-9fce-27a5704c668a admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.812417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc3f8-5551-4267-9fce-27a5704c668a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.812686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc3f8-5551-4267-9fce-27a5704c668a admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.813597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edc3f8-5551-4267-9fce-27a5704c668a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.814923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edc3f8-5551-4267-9fce-27a5704c668a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.825097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 790/1578] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:30.826095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edc3f8-5551-4267-9fce-27a5704c668a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.835302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 789/1579] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.836073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edc3f8-5551-4267-9fce-27a5704c668a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.836212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614addce-630e-4851-adf8-60f5feb772ae admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.894544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ed683-13a2-4c37-868d-caf19dfdf1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.895192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed683-13a2-4c37-868d-caf19dfdf1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.895450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed683-13a2-4c37-868d-caf19dfdf1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.895778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed683-13a2-4c37-868d-caf19dfdf1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.896397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ed683-13a2-4c37-868d-caf19dfdf1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.898325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ed683-13a2-4c37-868d-caf19dfdf1d9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.900903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614addce-630e-4851-adf8-60f5feb772ae admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:30.905640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df07e6-d961-4708-a384-7218d3d8993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:30.906335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df07e6-d961-4708-a384-7218d3d8993f admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:30.906614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df07e6-d961-4708-a384-7218d3d8993f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:30.906887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df07e6-d961-4708-a384-7218d3d8993f admin admin] PATH_INFO: `/v3/projects/3e637562d82f411db169011977a12cbd/users/8c1dd80884d842669997cdb306ce0d39/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:30.922592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df07e6-d961-4708-a384-7218d3d8993f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e637562d82f411db169011977a12cbd, user_id=8c1dd80884d842669997cdb306ce0d39, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:30.925253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df07e6-d961-4708-a384-7218d3d8993f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:30.925985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 791/1580] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:30.930686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ed683-13a2-4c37-868d-caf19dfdf1d9 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.940065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 790/1581] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:30 2022] PUT /identity/v3/projects/3e637562d82f411db169011977a12cbd/users/8c1dd80884d842669997cdb306ce0d39/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:30.940826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df07e6-d961-4708-a384-7218d3d8993f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:30.949648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:30.961835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:31.000054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ed683-13a2-4c37-868d-caf19dfdf1d9 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.004758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6c10c-e1b5-40c3-9f83-f06102d1b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.005359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6c10c-e1b5-40c3-9f83-f06102d1b194 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.005642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6c10c-e1b5-40c3-9f83-f06102d1b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.005914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6c10c-e1b5-40c3-9f83-f06102d1b194 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.006568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6c10c-e1b5-40c3-9f83-f06102d1b194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.007614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df07e6-d961-4708-a384-7218d3d8993f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.008515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6c10c-e1b5-40c3-9f83-f06102d1b194 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.012256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbb5a-148f-4e06-bb79-924174ae5b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.012861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbb5a-148f-4e06-bb79-924174ae5b62 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.013145 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbb5a-148f-4e06-bb79-924174ae5b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.013425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbb5a-148f-4e06-bb79-924174ae5b62 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.014045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddbb5a-148f-4e06-bb79-924174ae5b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.016019 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddbb5a-148f-4e06-bb79-924174ae5b62 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.032849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 792/1582] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:31.032849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed8bc-a823-4412-8247-f3def1c0ee18 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.032849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed8bc-a823-4412-8247-f3def1c0ee18 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.032849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed8bc-a823-4412-8247-f3def1c0ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.040038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 791/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:30 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:31.041000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbb5a-148f-4e06-bb79-924174ae5b62 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.051162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbb5a-148f-4e06-bb79-924174ae5b62 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.051317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-296ed8bc-a823-4412-8247-f3def1c0ee18 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:31.052408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-296ed8bc-a823-4412-8247-f3def1c0ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:31.056084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf6e45-259f-467b-9254-c6848ea194f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.056782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf6e45-259f-467b-9254-c6848ea194f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.057125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf6e45-259f-467b-9254-c6848ea194f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.057406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf6e45-259f-467b-9254-c6848ea194f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.058020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf6e45-259f-467b-9254-c6848ea194f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.059961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf6e45-259f-467b-9254-c6848ea194f6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.060124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 793/1584] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:31.060777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ed8bc-a823-4412-8247-f3def1c0ee18 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.070469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ed8bc-a823-4412-8247-f3def1c0ee18 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.075270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477798f-ed7c-410f-bf3d-3ad562f56536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.076000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477798f-ed7c-410f-bf3d-3ad562f56536 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.076281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477798f-ed7c-410f-bf3d-3ad562f56536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.076699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477798f-ed7c-410f-bf3d-3ad562f56536 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.077430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477798f-ed7c-410f-bf3d-3ad562f56536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.079135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477798f-ed7c-410f-bf3d-3ad562f56536 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.083287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 792/1585] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:31 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:31.084187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf6e45-259f-467b-9254-c6848ea194f6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.092569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 794/1586] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.093488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477798f-ed7c-410f-bf3d-3ad562f56536 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.093599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf6e45-259f-467b-9254-c6848ea194f6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.100770 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ba074-629f-4848-a913-238c1a1de868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.101360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ba074-629f-4848-a913-238c1a1de868 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.101640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ba074-629f-4848-a913-238c1a1de868 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.101914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ba074-629f-4848-a913-238c1a1de868 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.102561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ba074-629f-4848-a913-238c1a1de868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.103808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477798f-ed7c-410f-bf3d-3ad562f56536 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.104511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ba074-629f-4848-a913-238c1a1de868 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.108390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4aba-9b94-49c1-acfa-890b60441a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.108959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4aba-9b94-49c1-acfa-890b60441a31 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.109237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4aba-9b94-49c1-acfa-890b60441a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.109504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4aba-9b94-49c1-acfa-890b60441a31 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.110135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4aba-9b94-49c1-acfa-890b60441a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.111999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4aba-9b94-49c1-acfa-890b60441a31 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.127348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 793/1587] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:31 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:31.128574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69bd4-6fd6-41af-a5c3-0db38e683c92 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.128860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69bd4-6fd6-41af-a5c3-0db38e683c92 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.129137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69bd4-6fd6-41af-a5c3-0db38e683c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.137796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 795/1588] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:31 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:31.139080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4aba-9b94-49c1-acfa-890b60441a31 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.149905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4aba-9b94-49c1-acfa-890b60441a31 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.151569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-1ba69bd4-6fd6-41af-a5c3-0db38e683c92 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:31.152754 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1ba69bd4-6fd6-41af-a5c3-0db38e683c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:31.154626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5055bd-a096-443e-b9f5-96af4f2f76dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.155231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5055bd-a096-443e-b9f5-96af4f2f76dc admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.155511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5055bd-a096-443e-b9f5-96af4f2f76dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.155783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5055bd-a096-443e-b9f5-96af4f2f76dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.156447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5055bd-a096-443e-b9f5-96af4f2f76dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.158016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5055bd-a096-443e-b9f5-96af4f2f76dc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.160417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 794/1589] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:31.161200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69bd4-6fd6-41af-a5c3-0db38e683c92 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.170558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69bd4-6fd6-41af-a5c3-0db38e683c92 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.171752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 796/1590] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.172491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5055bd-a096-443e-b9f5-96af4f2f76dc admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.177616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c1c9-bf4b-4563-afbc-d593bedef0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.178260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c1c9-bf4b-4563-afbc-d593bedef0fb admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.178536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c1c9-bf4b-4563-afbc-d593bedef0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.178831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c1c9-bf4b-4563-afbc-d593bedef0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.179428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c1c9-bf4b-4563-afbc-d593bedef0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.181058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c1c9-bf4b-4563-afbc-d593bedef0fb admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.191112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 795/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.191749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c1c9-bf4b-4563-afbc-d593bedef0fb admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.201424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c1c9-bf4b-4563-afbc-d593bedef0fb admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.206187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ae038-24c1-49aa-a0b8-a0fe82f9ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.206781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae038-24c1-49aa-a0b8-a0fe82f9ed5d admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.207057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae038-24c1-49aa-a0b8-a0fe82f9ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.207326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae038-24c1-49aa-a0b8-a0fe82f9ed5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.207947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ae038-24c1-49aa-a0b8-a0fe82f9ed5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.209703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ae038-24c1-49aa-a0b8-a0fe82f9ed5d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.219543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 796/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.220124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ae038-24c1-49aa-a0b8-a0fe82f9ed5d admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.229304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ae038-24c1-49aa-a0b8-a0fe82f9ed5d admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.234305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e625d0-a786-45c3-8155-ff734feace6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.234444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5055bd-a096-443e-b9f5-96af4f2f76dc admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.234922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e625d0-a786-45c3-8155-ff734feace6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.235199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e625d0-a786-45c3-8155-ff734feace6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.235470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e625d0-a786-45c3-8155-ff734feace6a admin admin] PATH_INFO: `/v3/projects/6ffe0a1873fc4fb4a0e3924d16840e52/users/d96cd2348dc14beeb6fafe55db57c13a/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.237841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937a5e-7801-4c85-9b24-34c75ec8480d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.238932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937a5e-7801-4c85-9b24-34c75ec8480d service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.238932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937a5e-7801-4c85-9b24-34c75ec8480d service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.239144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937a5e-7801-4c85-9b24-34c75ec8480d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.249720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e937a5e-7801-4c85-9b24-34c75ec8480d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.250697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e625d0-a786-45c3-8155-ff734feace6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffe0a1873fc4fb4a0e3924d16840e52, user_id=d96cd2348dc14beeb6fafe55db57c13a, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.251189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e937a5e-7801-4c85-9b24-34c75ec8480d service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.253344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e625d0-a786-45c3-8155-ff734feace6a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.265193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 797/1593] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:31.266230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937a5e-7801-4c85-9b24-34c75ec8480d service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.272326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 797/1594] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:31 2022] PUT /identity/v3/projects/6ffe0a1873fc4fb4a0e3924d16840e52/users/d96cd2348dc14beeb6fafe55db57c13a/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:31.272326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e625d0-a786-45c3-8155-ff734feace6a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.277206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937a5e-7801-4c85-9b24-34c75ec8480d service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.343482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e625d0-a786-45c3-8155-ff734feace6a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.348487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b454d6-5a17-4caa-88d9-646b3464c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.348715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e19a96-2e1a-46e6-be9d-d955f6ee9145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.349775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b454d6-5a17-4caa-88d9-646b3464c6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.349917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e19a96-2e1a-46e6-be9d-d955f6ee9145 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.350153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b454d6-5a17-4caa-88d9-646b3464c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.350260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e19a96-2e1a-46e6-be9d-d955f6ee9145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.350426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b454d6-5a17-4caa-88d9-646b3464c6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.350524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e19a96-2e1a-46e6-be9d-d955f6ee9145 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.351214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e19a96-2e1a-46e6-be9d-d955f6ee9145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.351353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b454d6-5a17-4caa-88d9-646b3464c6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.352948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e19a96-2e1a-46e6-be9d-d955f6ee9145 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.353454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b454d6-5a17-4caa-88d9-646b3464c6d8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.365201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 798/1595] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.366231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 798/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.366745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e19a96-2e1a-46e6-be9d-d955f6ee9145 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.367335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b454d6-5a17-4caa-88d9-646b3464c6d8 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.374950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:31.377910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:31.379940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b454d6-5a17-4caa-88d9-646b3464c6d8 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.388506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f235d88-e0c7-41c4-8141-74588b081165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.389216 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f235d88-e0c7-41c4-8141-74588b081165 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.389523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f235d88-e0c7-41c4-8141-74588b081165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.389866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f235d88-e0c7-41c4-8141-74588b081165 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.390588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f235d88-e0c7-41c4-8141-74588b081165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.392471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f235d88-e0c7-41c4-8141-74588b081165 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.406732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 799/1597] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.407805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f235d88-e0c7-41c4-8141-74588b081165 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.418804 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f235d88-e0c7-41c4-8141-74588b081165 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.426133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735512db-15a5-4482-bdb5-daa01bf920ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.427617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735512db-15a5-4482-bdb5-daa01bf920ed admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.428246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735512db-15a5-4482-bdb5-daa01bf920ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.428246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735512db-15a5-4482-bdb5-daa01bf920ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.428953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735512db-15a5-4482-bdb5-daa01bf920ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.431223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735512db-15a5-4482-bdb5-daa01bf920ed admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.442015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e19a96-2e1a-46e6-be9d-d955f6ee9145 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.444145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 800/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.447253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735512db-15a5-4482-bdb5-daa01bf920ed admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.454565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64095a6b-b9bc-43c0-82bd-39f9af861831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.455156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64095a6b-b9bc-43c0-82bd-39f9af861831 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.455810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64095a6b-b9bc-43c0-82bd-39f9af861831 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.456224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64095a6b-b9bc-43c0-82bd-39f9af861831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.458298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735512db-15a5-4482-bdb5-daa01bf920ed admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.464390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318dec-4595-4475-9ab4-47a41b41e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.465180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318dec-4595-4475-9ab4-47a41b41e082 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.465551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318dec-4595-4475-9ab4-47a41b41e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.465887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318dec-4595-4475-9ab4-47a41b41e082 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.466669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3318dec-4595-4475-9ab4-47a41b41e082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.468380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3318dec-4595-4475-9ab4-47a41b41e082 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.468603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64095a6b-b9bc-43c0-82bd-39f9af861831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.470346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64095a6b-b9bc-43c0-82bd-39f9af861831 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.482371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 801/1599] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.482371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9800de-d0a1-42e0-ad63-bd36860aadfc None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.482371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9800de-d0a1-42e0-ad63-bd36860aadfc None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.482371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9800de-d0a1-42e0-ad63-bd36860aadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.482996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 799/1600] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:31.483533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64095a6b-b9bc-43c0-82bd-39f9af861831 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.496588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64095a6b-b9bc-43c0-82bd-39f9af861831 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.502385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028d2cf-3caa-4eab-a0f5-a82722f61e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.503114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d2cf-3caa-4eab-a0f5-a82722f61e78 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.503467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d2cf-3caa-4eab-a0f5-a82722f61e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.503829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d2cf-3caa-4eab-a0f5-a82722f61e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.504514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028d2cf-3caa-4eab-a0f5-a82722f61e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.506936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028d2cf-3caa-4eab-a0f5-a82722f61e78 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.509513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ad9800de-d0a1-42e0-ad63-bd36860aadfc None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:31.510784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ad9800de-d0a1-42e0-ad63-bd36860aadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:31.517821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 800/1601] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.518957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028d2cf-3caa-4eab-a0f5-a82722f61e78 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.521504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 802/1602] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:31.522375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9800de-d0a1-42e0-ad63-bd36860aadfc None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.538564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9800de-d0a1-42e0-ad63-bd36860aadfc None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.539412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028d2cf-3caa-4eab-a0f5-a82722f61e78 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.544719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66368923-eeba-4a77-8a36-ef57bc879ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.545213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368923-eeba-4a77-8a36-ef57bc879ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.545494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368923-eeba-4a77-8a36-ef57bc879ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.545764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368923-eeba-4a77-8a36-ef57bc879ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.546551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66368923-eeba-4a77-8a36-ef57bc879ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.547568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13607dbc-76fd-4258-a3a1-530808e7f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.547999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607dbc-76fd-4258-a3a1-530808e7f5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.548146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66368923-eeba-4a77-8a36-ef57bc879ae8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.548584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607dbc-76fd-4258-a3a1-530808e7f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.548993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607dbc-76fd-4258-a3a1-530808e7f5d3 admin admin] PATH_INFO: `/v3/projects/0a396293b81d43a4ada96b3d49e7dae7/users/17cc8db0bbd24c4098931f2c53381751/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.560701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 801/1603] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:31.564668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66368923-eeba-4a77-8a36-ef57bc879ae8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.568812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13607dbc-76fd-4258-a3a1-530808e7f5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a396293b81d43a4ada96b3d49e7dae7, user_id=17cc8db0bbd24c4098931f2c53381751, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.573842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13607dbc-76fd-4258-a3a1-530808e7f5d3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.574708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66368923-eeba-4a77-8a36-ef57bc879ae8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.579585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd1b0e-ac36-49d8-983c-fe5677f3589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.580346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1b0e-ac36-49d8-983c-fe5677f3589b admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.580720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1b0e-ac36-49d8-983c-fe5677f3589b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.581092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1b0e-ac36-49d8-983c-fe5677f3589b admin admin] PATH_INFO: `/v3/projects/b17f191721bd4fef9cc0df6eb1d450ef/users/41631422a99049828b6f3845f8d508b7/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.598232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 803/1604] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:31 2022] PUT /identity/v3/projects/0a396293b81d43a4ada96b3d49e7dae7/users/17cc8db0bbd24c4098931f2c53381751/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:31.600172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13607dbc-76fd-4258-a3a1-530808e7f5d3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.601081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd1b0e-ac36-49d8-983c-fe5677f3589b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17f191721bd4fef9cc0df6eb1d450ef, user_id=41631422a99049828b6f3845f8d508b7, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.604218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd1b0e-ac36-49d8-983c-fe5677f3589b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.628235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 802/1605] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:31 2022] PUT /identity/v3/projects/b17f191721bd4fef9cc0df6eb1d450ef/users/41631422a99049828b6f3845f8d508b7/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:31.629677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd1b0e-ac36-49d8-983c-fe5677f3589b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.689184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13607dbc-76fd-4258-a3a1-530808e7f5d3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.718162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd1b0e-ac36-49d8-983c-fe5677f3589b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.726902 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75796c8-1e70-419d-aa88-b761525d6de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.728838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75796c8-1e70-419d-aa88-b761525d6de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.729156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75796c8-1e70-419d-aa88-b761525d6de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.729814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75796c8-1e70-419d-aa88-b761525d6de6 admin admin] PATH_INFO: `/v3/projects/66a34b0ac3e04b6aa593e8b6097a011e/users/3e3151bac78942a69fb3764d5ef3814c/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.750972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75796c8-1e70-419d-aa88-b761525d6de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a34b0ac3e04b6aa593e8b6097a011e, user_id=3e3151bac78942a69fb3764d5ef3814c, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.751977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.752789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.753172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.753566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] PATH_INFO: `/v3/projects/5790e0e3f74f48ac9e1972ecba462f94/users/94003e5ac98e4ef6b8ef42145884c4ee/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.756091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75796c8-1e70-419d-aa88-b761525d6de6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.771841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5790e0e3f74f48ac9e1972ecba462f94, user_id=94003e5ac98e4ef6b8ef42145884c4ee, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.775552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:31.795672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 804/1606] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:31 2022] PUT /identity/v3/projects/5790e0e3f74f48ac9e1972ecba462f94/users/94003e5ac98e4ef6b8ef42145884c4ee/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:31.796369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.798692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:31.801402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 803/1607] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:31 2022] PUT /identity/v3/projects/66a34b0ac3e04b6aa593e8b6097a011e/users/3e3151bac78942a69fb3764d5ef3814c/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:31.805322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75796c8-1e70-419d-aa88-b761525d6de6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:31.841046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:31.868304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78730c-bf4d-4e3b-a66a-8ff763ef3a69 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:31.873107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ee4e-1c8e-4d2d-8098-1e7f8ca42849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:31.873996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ee4e-1c8e-4d2d-8098-1e7f8ca42849 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:31.874397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ee4e-1c8e-4d2d-8098-1e7f8ca42849 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:31.874806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ee4e-1c8e-4d2d-8098-1e7f8ca42849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:31.960681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:31.970704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ee4e-1c8e-4d2d-8098-1e7f8ca42849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:31.973153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ee4e-1c8e-4d2d-8098-1e7f8ca42849 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:32.001156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 805/1608] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:32.002097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75796c8-1e70-419d-aa88-b761525d6de6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:32.002661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396241-0195-439e-a521-b755c2bf380e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.003005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396241-0195-439e-a521-b755c2bf380e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.003351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396241-0195-439e-a521-b755c2bf380e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.015141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200f7e-adf4-4110-bfd6-1737add5632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:32.015835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200f7e-adf4-4110-bfd6-1737add5632e admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.016123 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200f7e-adf4-4110-bfd6-1737add5632e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.016405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200f7e-adf4-4110-bfd6-1737add5632e admin admin] PATH_INFO: `/v3/projects/73c2f294f52343bcb172dd7f2e9ae8ca/users/18c628d7db8d4040be2c44513a58d3bd/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.035302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-88396241-0195-439e-a521-b755c2bf380e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:32.038325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6200f7e-adf4-4110-bfd6-1737add5632e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c2f294f52343bcb172dd7f2e9ae8ca, user_id=18c628d7db8d4040be2c44513a58d3bd, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:32.039549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-88396241-0195-439e-a521-b755c2bf380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:32.041663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6200f7e-adf4-4110-bfd6-1737add5632e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:32.053922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 806/1609] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:32.055401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091635ad-e144-494b-8c57-badf7330ad72 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.055793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091635ad-e144-494b-8c57-badf7330ad72 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.056175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091635ad-e144-494b-8c57-badf7330ad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.076371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 804/1610] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:31 2022] PUT /identity/v3/projects/73c2f294f52343bcb172dd7f2e9ae8ca/users/18c628d7db8d4040be2c44513a58d3bd/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:32.076371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6b28-bd15-4ee1-916d-fc25e7ea460a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.076371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6b28-bd15-4ee1-916d-fc25e7ea460a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.076371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6b28-bd15-4ee1-916d-fc25e7ea460a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.110843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-091635ad-e144-494b-8c57-badf7330ad72 None None] MFA Rules not processed for user `41631422a99049828b6f3845f8d508b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:32.112304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-091635ad-e144-494b-8c57-badf7330ad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:32.166173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-ec1b6b28-bd15-4ee1-916d-fc25e7ea460a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:32.169187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ec1b6b28-bd15-4ee1-916d-fc25e7ea460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:32.248411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 807/1611] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:32.248411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5000b-fa8f-4767-9458-378ac381b876 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.248411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5000b-fa8f-4767-9458-378ac381b876 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.248411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5000b-fa8f-4767-9458-378ac381b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.314609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 805/1612] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:32.314609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8da27-212b-4b1a-9ae9-c4672bf0feb2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.314609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8da27-212b-4b1a-9ae9-c4672bf0feb2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.314609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8da27-212b-4b1a-9ae9-c4672bf0feb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.326460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-95b5000b-fa8f-4767-9458-378ac381b876 None None] MFA Rules not processed for user `94003e5ac98e4ef6b8ef42145884c4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:32.328910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-95b5000b-fa8f-4767-9458-378ac381b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:32.351464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-62e8da27-212b-4b1a-9ae9-c4672bf0feb2 None None] MFA Rules not processed for user `18c628d7db8d4040be2c44513a58d3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:32.353198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-62e8da27-212b-4b1a-9ae9-c4672bf0feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:32.456245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:32.471488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 808/1613] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:32.472478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5000b-fa8f-4767-9458-378ac381b876 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:32.547885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 806/1614] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:32.561690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8da27-212b-4b1a-9ae9-c4672bf0feb2 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:32.600785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8da27-212b-4b1a-9ae9-c4672bf0feb2 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:32.612063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59891fb4-016b-4ba2-a947-c1a8ce237091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:32.612687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59891fb4-016b-4ba2-a947-c1a8ce237091 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.612968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59891fb4-016b-4ba2-a947-c1a8ce237091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.613279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59891fb4-016b-4ba2-a947-c1a8ce237091 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.615546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59891fb4-016b-4ba2-a947-c1a8ce237091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:32.619126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5000b-fa8f-4767-9458-378ac381b876 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:32.623012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59891fb4-016b-4ba2-a947-c1a8ce237091 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:32.628770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7dcf-18cc-4bfc-9066-6275db4ad511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:32.629466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7dcf-18cc-4bfc-9066-6275db4ad511 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.629748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7dcf-18cc-4bfc-9066-6275db4ad511 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.631144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7dcf-18cc-4bfc-9066-6275db4ad511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.662648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a7dcf-18cc-4bfc-9066-6275db4ad511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:32.664746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a7dcf-18cc-4bfc-9066-6275db4ad511 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:32.679713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 809/1615] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:32.680970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7dcf-18cc-4bfc-9066-6275db4ad511 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:32.687636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 807/1616] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:32.688738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59891fb4-016b-4ba2-a947-c1a8ce237091 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:32.694040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7dcf-18cc-4bfc-9066-6275db4ad511 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:32.776657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523460fb-b6de-4e3f-9dc0-fd0591ae7416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:32.777331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523460fb-b6de-4e3f-9dc0-fd0591ae7416 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.777675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523460fb-b6de-4e3f-9dc0-fd0591ae7416 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.777952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523460fb-b6de-4e3f-9dc0-fd0591ae7416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.789500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:32.841821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59891fb4-016b-4ba2-a947-c1a8ce237091 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:32.851709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3e702-7793-40a7-8975-64dbc3f82ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:32.852492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3e702-7793-40a7-8975-64dbc3f82ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.852777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3e702-7793-40a7-8975-64dbc3f82ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.853051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3e702-7793-40a7-8975-64dbc3f82ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.853830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3e702-7793-40a7-8975-64dbc3f82ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:32.856014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3e702-7793-40a7-8975-64dbc3f82ea3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:32.888162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523460fb-b6de-4e3f-9dc0-fd0591ae7416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:32.890664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523460fb-b6de-4e3f-9dc0-fd0591ae7416 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:32.909519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 810/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:32.925794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 808/1618] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/projects => generated 403 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:32.926392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551abeb-fd3e-4dc3-9fd7-769d18bdc5e7 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:32.926686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551abeb-fd3e-4dc3-9fd7-769d18bdc5e7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:32.928093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3e702-7793-40a7-8975-64dbc3f82ea3 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:32.929295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551abeb-fd3e-4dc3-9fd7-769d18bdc5e7 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:32.932510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 811/1619] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 8 00:28:32 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:28:32.935713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551abeb-fd3e-4dc3-9fd7-769d18bdc5e7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.107334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:33.121315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3e702-7793-40a7-8975-64dbc3f82ea3 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.131938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc8f03-3f28-4359-874d-4034a453fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.132728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8f03-3f28-4359-874d-4034a453fcac admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.133096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8f03-3f28-4359-874d-4034a453fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.133519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8f03-3f28-4359-874d-4034a453fcac admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.134830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc8f03-3f28-4359-874d-4034a453fcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.138025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc8f03-3f28-4359-874d-4034a453fcac admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.147484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551abeb-fd3e-4dc3-9fd7-769d18bdc5e7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.162520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23550896-84ec-4981-aa01-193b66c83a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.163328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23550896-84ec-4981-aa01-193b66c83a74 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.164551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23550896-84ec-4981-aa01-193b66c83a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.168027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23550896-84ec-4981-aa01-193b66c83a74 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.169315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23550896-84ec-4981-aa01-193b66c83a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.174987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23550896-84ec-4981-aa01-193b66c83a74 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.188031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 809/1620] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:33.197838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f29d0e-f25c-4616-94eb-1c8d3431a76f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.198294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f29d0e-f25c-4616-94eb-1c8d3431a76f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.198576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f29d0e-f25c-4616-94eb-1c8d3431a76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.242415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 812/1621] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:32 2022] POST /identity/v3/users => generated 308 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:33.242415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23550896-84ec-4981-aa01-193b66c83a74 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.266737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23550896-84ec-4981-aa01-193b66c83a74 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.278761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edf245-8d08-4d44-a3b5-37d0c1df2b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.279749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf245-8d08-4d44-a3b5-37d0c1df2b7e admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.280034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf245-8d08-4d44-a3b5-37d0c1df2b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.280307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf245-8d08-4d44-a3b5-37d0c1df2b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.284215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edf245-8d08-4d44-a3b5-37d0c1df2b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.285842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edf245-8d08-4d44-a3b5-37d0c1df2b7e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.299584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-56f29d0e-f25c-4616-94eb-1c8d3431a76f None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:33.302177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-56f29d0e-f25c-4616-94eb-1c8d3431a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:33.320268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 813/1622] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:33.321254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edf245-8d08-4d44-a3b5-37d0c1df2b7e admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.345879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edf245-8d08-4d44-a3b5-37d0c1df2b7e admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.361636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90490754-8cf2-4639-ab7a-77bc33189677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.362226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490754-8cf2-4639-ab7a-77bc33189677 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.362512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490754-8cf2-4639-ab7a-77bc33189677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.362791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490754-8cf2-4639-ab7a-77bc33189677 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.363432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90490754-8cf2-4639-ab7a-77bc33189677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.365142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90490754-8cf2-4639-ab7a-77bc33189677 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.394909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 814/1623] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:33.397672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90490754-8cf2-4639-ab7a-77bc33189677 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.424504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90490754-8cf2-4639-ab7a-77bc33189677 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.440704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba2d81-b46f-495c-8655-0ef95e54bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.443197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2d81-b46f-495c-8655-0ef95e54bd61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.443545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2d81-b46f-495c-8655-0ef95e54bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.444850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2d81-b46f-495c-8655-0ef95e54bd61 admin admin] PATH_INFO: `/v3/projects/261c93fd3b2046cbb91498d4879216c4/users/50a004ac37fa434cb3dd6993e0b3d059/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.450020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 810/1624] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 8 00:28:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:33.453202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f29d0e-f25c-4616-94eb-1c8d3431a76f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.482631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f29d0e-f25c-4616-94eb-1c8d3431a76f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.483843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba2d81-b46f-495c-8655-0ef95e54bd61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261c93fd3b2046cbb91498d4879216c4, user_id=50a004ac37fa434cb3dd6993e0b3d059, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.490911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba2d81-b46f-495c-8655-0ef95e54bd61 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.495736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b92e-fd48-4f40-a9bc-1373328e892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.498624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b92e-fd48-4f40-a9bc-1373328e892b admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.499397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b92e-fd48-4f40-a9bc-1373328e892b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.499743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b92e-fd48-4f40-a9bc-1373328e892b admin admin] PATH_INFO: `/v3/projects/86e7c13a365b4566b44bcd467819b120/users/9f9de7388bcb423d8d624d7fa1c8367c/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.528857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 815/1625] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:33 2022] PUT /identity/v3/projects/261c93fd3b2046cbb91498d4879216c4/users/50a004ac37fa434cb3dd6993e0b3d059/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:33.534955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba2d81-b46f-495c-8655-0ef95e54bd61 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.552683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879b92e-fd48-4f40-a9bc-1373328e892b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e7c13a365b4566b44bcd467819b120, user_id=9f9de7388bcb423d8d624d7fa1c8367c, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.564243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879b92e-fd48-4f40-a9bc-1373328e892b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.598723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 811/1626] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:33 2022] PUT /identity/v3/projects/86e7c13a365b4566b44bcd467819b120/users/9f9de7388bcb423d8d624d7fa1c8367c/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:33.600360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b92e-fd48-4f40-a9bc-1373328e892b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.616113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:33.683811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba2d81-b46f-495c-8655-0ef95e54bd61 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.715680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b92e-fd48-4f40-a9bc-1373328e892b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.726362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ee894-1bcf-45ee-a94e-5f193e50b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.726985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ee894-1bcf-45ee-a94e-5f193e50b500 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.727273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ee894-1bcf-45ee-a94e-5f193e50b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.727548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ee894-1bcf-45ee-a94e-5f193e50b500 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.728204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ee894-1bcf-45ee-a94e-5f193e50b500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.729816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ee894-1bcf-45ee-a94e-5f193e50b500 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.753874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 812/1627] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:33.754710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ee894-1bcf-45ee-a94e-5f193e50b500 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.788504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ee894-1bcf-45ee-a94e-5f193e50b500 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.796979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b39bf2-290f-48d4-b765-c50e4bae82a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.797676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b39bf2-290f-48d4-b765-c50e4bae82a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.797961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b39bf2-290f-48d4-b765-c50e4bae82a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.798323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b39bf2-290f-48d4-b765-c50e4bae82a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.799034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b39bf2-290f-48d4-b765-c50e4bae82a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.800643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b39bf2-290f-48d4-b765-c50e4bae82a4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.807563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c10e2-25d5-4dfa-ad45-0326431491f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.808507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c10e2-25d5-4dfa-ad45-0326431491f0 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.808976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c10e2-25d5-4dfa-ad45-0326431491f0 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.809552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c10e2-25d5-4dfa-ad45-0326431491f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.847050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 813/1628] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:33.848187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b39bf2-290f-48d4-b765-c50e4bae82a4 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.865324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:33.869245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b39bf2-290f-48d4-b765-c50e4bae82a4 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:33.885187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d84dd3-e9ca-4dbd-a0be-c5726013b9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:33.886314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d84dd3-e9ca-4dbd-a0be-c5726013b9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.886970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d84dd3-e9ca-4dbd-a0be-c5726013b9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.887502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d84dd3-e9ca-4dbd-a0be-c5726013b9f8 admin admin] PATH_INFO: `/v3/projects/261c93fd3b2046cbb91498d4879216c4/users/50a004ac37fa434cb3dd6993e0b3d059/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:33.895338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d84dd3-e9ca-4dbd-a0be-c5726013b9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261c93fd3b2046cbb91498d4879216c4, user_id=50a004ac37fa434cb3dd6993e0b3d059, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.900112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d84dd3-e9ca-4dbd-a0be-c5726013b9f8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.915239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c10e2-25d5-4dfa-ad45-0326431491f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:33.917187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c10e2-25d5-4dfa-ad45-0326431491f0 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:33.924076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 814/1629] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:33 2022] PUT /identity/v3/projects/261c93fd3b2046cbb91498d4879216c4/users/50a004ac37fa434cb3dd6993e0b3d059/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:33.924918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d84dd3-e9ca-4dbd-a0be-c5726013b9f8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:33.935848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 816/1630] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:33.938021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d074b6-cb70-4bf6-b2eb-56bf060eeb66 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:33.938387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d074b6-cb70-4bf6-b2eb-56bf060eeb66 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:33.939279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d074b6-cb70-4bf6-b2eb-56bf060eeb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:34.013267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-93d074b6-cb70-4bf6-b2eb-56bf060eeb66 None None] MFA Rules not processed for user `50a004ac37fa434cb3dd6993e0b3d059`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:34.016296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-93d074b6-cb70-4bf6-b2eb-56bf060eeb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:34.089098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d84dd3-e9ca-4dbd-a0be-c5726013b9f8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:34.095030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8435-6921-4b15-aaf1-82d7ffd6ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:34.097170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8435-6921-4b15-aaf1-82d7ffd6ba94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:34.097762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8435-6921-4b15-aaf1-82d7ffd6ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:34.099331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8435-6921-4b15-aaf1-82d7ffd6ba94 admin admin] PATH_INFO: `/v3/projects/86e7c13a365b4566b44bcd467819b120/users/9f9de7388bcb423d8d624d7fa1c8367c/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:34.102205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c8435-6921-4b15-aaf1-82d7ffd6ba94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e7c13a365b4566b44bcd467819b120, user_id=9f9de7388bcb423d8d624d7fa1c8367c, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:34.105873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c8435-6921-4b15-aaf1-82d7ffd6ba94 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:34.137489 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 815/1631] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:33 2022] PUT /identity/v3/projects/86e7c13a365b4566b44bcd467819b120/users/9f9de7388bcb423d8d624d7fa1c8367c/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:34.139297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987eba1-c0ca-41b2-b1b4-b984b00705a2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:34.139710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987eba1-c0ca-41b2-b1b4-b984b00705a2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:34.142503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987eba1-c0ca-41b2-b1b4-b984b00705a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:34.281765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-0987eba1-c0ca-41b2-b1b4-b984b00705a2 None None] MFA Rules not processed for user `9f9de7388bcb423d8d624d7fa1c8367c`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:34.281765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0987eba1-c0ca-41b2-b1b4-b984b00705a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:34.283708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 817/1632] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:34.283708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d074b6-cb70-4bf6-b2eb-56bf060eeb66 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:34.444067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:34.466527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d074b6-cb70-4bf6-b2eb-56bf060eeb66 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:34.475494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 816/1633] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:34.496192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987eba1-c0ca-41b2-b1b4-b984b00705a2 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:34.618412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec14cb-27d6-483d-842d-14fda8a8a0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:34.619028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec14cb-27d6-483d-842d-14fda8a8a0eb service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:34.619358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec14cb-27d6-483d-842d-14fda8a8a0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:34.619598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec14cb-27d6-483d-842d-14fda8a8a0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:34.652371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987eba1-c0ca-41b2-b1b4-b984b00705a2 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:34.659141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:34.660556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb62113-8a6c-454d-b6b3-d55421d1e617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:34.662026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62113-8a6c-454d-b6b3-d55421d1e617 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:34.664317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62113-8a6c-454d-b6b3-d55421d1e617 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:34.664722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62113-8a6c-454d-b6b3-d55421d1e617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:34.681586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb62113-8a6c-454d-b6b3-d55421d1e617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:34.683593 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb62113-8a6c-454d-b6b3-d55421d1e617 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:34.709886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 817/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:34 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:34.711263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1c3f3-e869-4ea3-bb1a-b1e373c06c78 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:34.711551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1c3f3-e869-4ea3-bb1a-b1e373c06c78 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:34.711832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1c3f3-e869-4ea3-bb1a-b1e373c06c78 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:34.715063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 818/1635] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 8 00:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:28:34.721571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c925-2cc6-4676-a50d-1f714b569eea None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:34.721863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c925-2cc6-4676-a50d-1f714b569eea None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:34.722272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c925-2cc6-4676-a50d-1f714b569eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:34.761054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec14cb-27d6-483d-842d-14fda8a8a0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:34.762588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec14cb-27d6-483d-842d-14fda8a8a0eb service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:34.773176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b8a4c925-2cc6-4676-a50d-1f714b569eea None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:34.777333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b8a4c925-2cc6-4676-a50d-1f714b569eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:34.786881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 818/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:34.971719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 819/1637] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:28:34.998102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec14cb-27d6-483d-842d-14fda8a8a0eb service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:35.010885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c925-2cc6-4676-a50d-1f714b569eea None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:35.012382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec14cb-27d6-483d-842d-14fda8a8a0eb service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:35.025025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d166a27-caac-4689-ba6b-5b117a05e984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:35.025605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d166a27-caac-4689-ba6b-5b117a05e984 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:35.027463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d166a27-caac-4689-ba6b-5b117a05e984 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:35.027762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d166a27-caac-4689-ba6b-5b117a05e984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:35.056491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c925-2cc6-4676-a50d-1f714b569eea None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:35.073938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef4477-6320-468f-8e8b-689436562a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:35.076840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4477-6320-468f-8e8b-689436562a01 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:35.077139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4477-6320-468f-8e8b-689436562a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:35.077463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4477-6320-468f-8e8b-689436562a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:35.102654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef4477-6320-468f-8e8b-689436562a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:35.105305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef4477-6320-468f-8e8b-689436562a01 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:35.138267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 820/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:35.171290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d166a27-caac-4689-ba6b-5b117a05e984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:35.173970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d166a27-caac-4689-ba6b-5b117a05e984 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:35.193223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 819/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:35.741047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef4477-6320-468f-8e8b-689436562a01 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:35.932035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef4477-6320-468f-8e8b-689436562a01 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:35.952207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:35.953864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:35.954618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:35.955192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] PATH_INFO: `/v3/users/94003e5ac98e4ef6b8ef42145884c4ee` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:35.957741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94003e5ac98e4ef6b8ef42145884c4ee)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:35.962707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:36.026330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:36.084088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94003e5ac98e4ef6b8ef42145884c4ee'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:36.097470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94003e5ac98e4ef6b8ef42145884c4ee'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:36.099427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94003e5ac98e4ef6b8ef42145884c4ee'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:36.111154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94003e5ac98e4ef6b8ef42145884c4ee'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:36.134257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94003e5ac98e4ef6b8ef42145884c4ee'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:36.142519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 821/1640] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:28:35 2022] DELETE /identity/v3/users/94003e5ac98e4ef6b8ef42145884c4ee => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:36.148555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884406-aa3e-4b65-944f-05625919fbf7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:36.149115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884406-aa3e-4b65-944f-05625919fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:36.149272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884406-aa3e-4b65-944f-05625919fbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:36.176379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-af884406-aa3e-4b65-944f-05625919fbf7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:36.178949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-af884406-aa3e-4b65-944f-05625919fbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:36.338997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 820/1641] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:36.455908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:36.457997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:36.609844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9336ab-664f-419e-98d4-5d31f23dbb54 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:36.619104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f41662-d2dd-4084-8d16-310253becac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:36.621141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f41662-d2dd-4084-8d16-310253becac4 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:36.621577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f41662-d2dd-4084-8d16-310253becac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:36.622002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f41662-d2dd-4084-8d16-310253becac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:36.635109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f41662-d2dd-4084-8d16-310253becac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:36.636904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f41662-d2dd-4084-8d16-310253becac4 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:36.654799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 822/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:36.794581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7e9f-c49f-4a41-b21d-2778e231a4e7 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:36.794919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7e9f-c49f-4a41-b21d-2778e231a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:36.795164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7e9f-c49f-4a41-b21d-2778e231a4e7 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:36.797154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 821/1643] 10.222.0.23 () {54 vars in 962 bytes} [Mon Aug 8 00:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:28:36.808569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced13cf-b887-4615-9fe7-dc2483bd2b83 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:36.809606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced13cf-b887-4615-9fe7-dc2483bd2b83 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:36.809899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced13cf-b887-4615-9fe7-dc2483bd2b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:36.863208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-5ced13cf-b887-4615-9fe7-dc2483bd2b83 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:36.864853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5ced13cf-b887-4615-9fe7-dc2483bd2b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:36.958043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 823/1644] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Aug 8 00:28:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:28:36.966636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff3a0d-1128-48ee-8209-e6b941355adc None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:36.966929 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff3a0d-1128-48ee-8209-e6b941355adc None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:36.969446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff3a0d-1128-48ee-8209-e6b941355adc None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:36.969446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 822/1645] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 8 00:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:28:36.978743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7551-dc1b-41a4-886a-1c0bfabbcbc4 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:36.979142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7551-dc1b-41a4-886a-1c0bfabbcbc4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:36.979460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7551-dc1b-41a4-886a-1c0bfabbcbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:37.005377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-678b7551-dc1b-41a4-886a-1c0bfabbcbc4 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:37.006920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-678b7551-dc1b-41a4-886a-1c0bfabbcbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:37.017945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 824/1646] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:28:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:37.035793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff3a0d-1128-48ee-8209-e6b941355adc None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:37.037666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-18ff3a0d-1128-48ee-8209-e6b941355adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:37.158205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff3a0d-1128-48ee-8209-e6b941355adc None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:37.169427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeebc7-a80c-4ead-a125-f64c0638417f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:37.171663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeebc7-a80c-4ead-a125-f64c0638417f service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:37.172469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeebc7-a80c-4ead-a125-f64c0638417f service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:37.172980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeebc7-a80c-4ead-a125-f64c0638417f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:37.190998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efeebc7-a80c-4ead-a125-f64c0638417f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:37.194480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efeebc7-a80c-4ead-a125-f64c0638417f service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:37.201861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:37.214188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 823/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:38.305622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b7551-dc1b-41a4-886a-1c0bfabbcbc4 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:38.307795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-678b7551-dc1b-41a4-886a-1c0bfabbcbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:38.352996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b7551-dc1b-41a4-886a-1c0bfabbcbc4 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:38.360261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:38.361022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:38.361379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:38.361728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] PATH_INFO: `/v3/projects/5790e0e3f74f48ac9e1972ecba462f94` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:38.370750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5790e0e3f74f48ac9e1972ecba462f94)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:38.371992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: WARNING py.warnings [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:28:38.371992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: warnings.warn(msg) Aug 08 00:28:38.371992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: Aug 08 00:28:38.373528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:38.456896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:38.583821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5790e0e3f74f48ac9e1972ecba462f94', 'request_id': 'req-854dd97c-2d64-4216-a274-60f9a84a7187'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:38.602242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5790e0e3f74f48ac9e1972ecba462f94', 'request_id': 'req-854dd97c-2d64-4216-a274-60f9a84a7187'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:38.632710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5790e0e3f74f48ac9e1972ecba462f94', 'request_id': 'req-854dd97c-2d64-4216-a274-60f9a84a7187'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:38.666197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] The token cache is being invalidate because project 5790e0e3f74f48ac9e1972ecba462f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:28:38.666492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:38.674662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:38.676724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 825/1648] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:28:38 2022] DELETE /identity/v3/projects/5790e0e3f74f48ac9e1972ecba462f94 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:38.683519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeebc7-a80c-4ead-a125-f64c0638417f service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:38.720335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeebc7-a80c-4ead-a125-f64c0638417f service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:38.841167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:38.844886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:38.845405 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:38.846570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] PATH_INFO: `/v3/users/9f9de7388bcb423d8d624d7fa1c8367c` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:38.848503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9de7388bcb423d8d624d7fa1c8367c)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:38.852815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: WARNING py.warnings [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:28:38.852815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: warnings.warn(msg) Aug 08 00:28:38.852815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: Aug 08 00:28:38.856198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:38.990853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9de7388bcb423d8d624d7fa1c8367c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:39.022037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9de7388bcb423d8d624d7fa1c8367c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:39.023141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9de7388bcb423d8d624d7fa1c8367c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:39.024360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9de7388bcb423d8d624d7fa1c8367c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:39.073608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2fb3cd73-584f-4b8b-9151-d0bdee17c2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9de7388bcb423d8d624d7fa1c8367c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:39.119448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 824/1649] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:28:38 2022] DELETE /identity/v3/users/9f9de7388bcb423d8d624d7fa1c8367c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:41.209979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:41.213835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:41.251042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dd97c-2d64-4216-a274-60f9a84a7187 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:41.404827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:41.405755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:41.407928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:41.408376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] PATH_INFO: `/v3/projects/86e7c13a365b4566b44bcd467819b120` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:41.411306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e7c13a365b4566b44bcd467819b120)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:41.417763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:41.575754 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e7c13a365b4566b44bcd467819b120', 'request_id': 'req-e24ee3c8-5165-47e2-996d-b8415fa147a6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:41.595719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e7c13a365b4566b44bcd467819b120', 'request_id': 'req-e24ee3c8-5165-47e2-996d-b8415fa147a6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:41.605392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e7c13a365b4566b44bcd467819b120', 'request_id': 'req-e24ee3c8-5165-47e2-996d-b8415fa147a6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:41.643527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] The token cache is being invalidate because project 86e7c13a365b4566b44bcd467819b120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:28:41.644031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:41.646162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e24ee3c8-5165-47e2-996d-b8415fa147a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:41.650851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 826/1650] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:28:41 2022] DELETE /identity/v3/projects/86e7c13a365b4566b44bcd467819b120 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:41.656297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cc75e-199e-4b0d-8b22-714e4934b54c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:41.657538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cc75e-199e-4b0d-8b22-714e4934b54c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:41.657953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cc75e-199e-4b0d-8b22-714e4934b54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:41.691066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-5e1cc75e-199e-4b0d-8b22-714e4934b54c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:41.697834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5e1cc75e-199e-4b0d-8b22-714e4934b54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:41.927140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 825/1651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:28:41.934458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609b80-f6c0-4a61-9598-585749bae640 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:41.934891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609b80-f6c0-4a61-9598-585749bae640 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:41.935069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609b80-f6c0-4a61-9598-585749bae640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:41.994667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7a609b80-f6c0-4a61-9598-585749bae640 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:41.999073 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7a609b80-f6c0-4a61-9598-585749bae640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:42.033743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 827/1652] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:42.037719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cc75e-199e-4b0d-8b22-714e4934b54c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:42.062315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cc75e-199e-4b0d-8b22-714e4934b54c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:42.082137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:42.083349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:42.083635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:42.083912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:42.084580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:42.084889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:42.087189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:42.132655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 826/1653] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:42.147904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a609b80-f6c0-4a61-9598-585749bae640 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:42.160998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a609b80-f6c0-4a61-9598-585749bae640 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:42.177253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60c972-dc06-4417-b0a0-dee91d56301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:42.177799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c972-dc06-4417-b0a0-dee91d56301a admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:42.178103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c972-dc06-4417-b0a0-dee91d56301a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:42.178384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c972-dc06-4417-b0a0-dee91d56301a admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:42.184879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60c972-dc06-4417-b0a0-dee91d56301a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:42.186897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60c972-dc06-4417-b0a0-dee91d56301a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:42.287132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 828/1654] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:42 2022] POST /identity/v3/projects => generated 401 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:42.291360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:42.300085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:42.315205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031bc05-7469-49d0-a66f-b9b8ceebf7db admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:42.535656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd251e-efab-484c-93e6-a10d10f9fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:42.536624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd251e-efab-484c-93e6-a10d10f9fcee admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:42.536930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd251e-efab-484c-93e6-a10d10f9fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:42.537289 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd251e-efab-484c-93e6-a10d10f9fcee admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:42.538990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd251e-efab-484c-93e6-a10d10f9fcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:42.543882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd251e-efab-484c-93e6-a10d10f9fcee admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:42.593495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 827/1655] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:42 2022] POST /identity/v3/users => generated 301 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:28:42.597180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60c972-dc06-4417-b0a0-dee91d56301a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:42.616752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60c972-dc06-4417-b0a0-dee91d56301a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:42.625138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d75903-4705-41f2-8a2a-cfe1a5513961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:42.626257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d75903-4705-41f2-8a2a-cfe1a5513961 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:42.628241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d75903-4705-41f2-8a2a-cfe1a5513961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:42.628686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d75903-4705-41f2-8a2a-cfe1a5513961 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:42.630139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d75903-4705-41f2-8a2a-cfe1a5513961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:42.637778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d75903-4705-41f2-8a2a-cfe1a5513961 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:42.641620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:42.677229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 829/1656] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:42.677684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd251e-efab-484c-93e6-a10d10f9fcee admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:42.692652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd251e-efab-484c-93e6-a10d10f9fcee admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:42.723639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc76c7c-52f5-421a-a2d8-a9619e13ec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:42.725611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc76c7c-52f5-421a-a2d8-a9619e13ec63 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:42.727605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc76c7c-52f5-421a-a2d8-a9619e13ec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:42.727995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc76c7c-52f5-421a-a2d8-a9619e13ec63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:42.728776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc76c7c-52f5-421a-a2d8-a9619e13ec63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:42.732104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc76c7c-52f5-421a-a2d8-a9619e13ec63 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:42.756372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d75903-4705-41f2-8a2a-cfe1a5513961 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:42.756638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 828/1657] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:42.768529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d75903-4705-41f2-8a2a-cfe1a5513961 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:42.780115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb5124-8cd1-444b-968b-bf53710749a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:42.781243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5124-8cd1-444b-968b-bf53710749a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:42.781633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5124-8cd1-444b-968b-bf53710749a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:42.782015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5124-8cd1-444b-968b-bf53710749a2 admin admin] PATH_INFO: `/v3/projects/077a90d479e44e6d8d2b51699c9b562c/users/a94e47f91ff04f9abe6db946a646e3f1/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:42.819626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb5124-8cd1-444b-968b-bf53710749a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077a90d479e44e6d8d2b51699c9b562c, user_id=a94e47f91ff04f9abe6db946a646e3f1, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:42.826741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb5124-8cd1-444b-968b-bf53710749a2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:42.870707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 830/1658] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:42 2022] PUT /identity/v3/projects/077a90d479e44e6d8d2b51699c9b562c/users/a94e47f91ff04f9abe6db946a646e3f1/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:28:42.892168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6cc2-9739-417c-8cd2-665112193aaa None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:42.892714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6cc2-9739-417c-8cd2-665112193aaa None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:42.899273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6cc2-9739-417c-8cd2-665112193aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:43.010786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-5d0f6cc2-9739-417c-8cd2-665112193aaa None None] MFA Rules not processed for user `a94e47f91ff04f9abe6db946a646e3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:43.012329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5d0f6cc2-9739-417c-8cd2-665112193aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:43.146692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 829/1659] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:42 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:43.147986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb5124-8cd1-444b-968b-bf53710749a2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:43.344191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9dd53-3577-4ba0-a024-cb68d8fa963c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:43.350160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9dd53-3577-4ba0-a024-cb68d8fa963c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:43.350160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9dd53-3577-4ba0-a024-cb68d8fa963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:43.449631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a0b9dd53-3577-4ba0-a024-cb68d8fa963c None None] MFA Rules not processed for user `61fca635a71c4d73af5225a428bfabdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:43.450707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a0b9dd53-3577-4ba0-a024-cb68d8fa963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:43.482093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb5124-8cd1-444b-968b-bf53710749a2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:43.501562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:43.502533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:43.503094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:43.505456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:43.506373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:43.508526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:43.608394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 831/1660] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:43 2022] POST /identity/v3/projects => generated 399 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:43.613462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:43.628821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:43.754978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 830/1661] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:43.755929 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9dd53-3577-4ba0-a024-cb68d8fa963c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:43.777951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:43.803229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9dd53-3577-4ba0-a024-cb68d8fa963c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:43.826281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca57752-326d-40df-8a1c-5d3230f3bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:43.826912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca57752-326d-40df-8a1c-5d3230f3bbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:43.827230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca57752-326d-40df-8a1c-5d3230f3bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:43.827518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca57752-326d-40df-8a1c-5d3230f3bbf9 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:43.828144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca57752-326d-40df-8a1c-5d3230f3bbf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:43.835634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca57752-326d-40df-8a1c-5d3230f3bbf9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:43.875946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24915f-ac47-44dc-8515-ac979aae6658 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:43.893592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:43.894268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:43.894556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:43.894823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] PATH_INFO: `/v3/users/18c628d7db8d4040be2c44513a58d3bd` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:43.907840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c628d7db8d4040be2c44513a58d3bd)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:43.913044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:43.919260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 831/1662] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:43 2022] POST /identity/v3/users => generated 306 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:43.924194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08a3b1-c789-461f-99f1-462955f36a65 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:43.927208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08a3b1-c789-461f-99f1-462955f36a65 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:43.927208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08a3b1-c789-461f-99f1-462955f36a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:44.009200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ab08a3b1-c789-461f-99f1-462955f36a65 None None] MFA Rules not processed for user `61fca635a71c4d73af5225a428bfabdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:44.015587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ab08a3b1-c789-461f-99f1-462955f36a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:44.057972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c628d7db8d4040be2c44513a58d3bd'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:44.070710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c628d7db8d4040be2c44513a58d3bd'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:44.074929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c628d7db8d4040be2c44513a58d3bd'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:44.113541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:44.121459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c628d7db8d4040be2c44513a58d3bd'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:44.164991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c628d7db8d4040be2c44513a58d3bd'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:44.186689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 832/1663] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:28:43 2022] DELETE /identity/v3/users/18c628d7db8d4040be2c44513a58d3bd => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:44.187710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:44.192701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:44.239905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 832/1664] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:44.241274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056045-1c95-449c-9981-04062a4cc7d0 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:44.241567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056045-1c95-449c-9981-04062a4cc7d0 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:44.241842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056045-1c95-449c-9981-04062a4cc7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:44.285323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-2d056045-1c95-449c-9981-04062a4cc7d0 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:44.286764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2d056045-1c95-449c-9981-04062a4cc7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:44.336313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cba4-97e1-4749-b0cd-5fe72f5cd8c8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:44.348939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:44.349884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:44.350202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:44.350483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:44.351216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:44.352905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:44.383242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 833/1665] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:44.384141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:44.385895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:44.405034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 833/1666] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:44.406542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056045-1c95-449c-9981-04062a4cc7d0 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:44.419194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056045-1c95-449c-9981-04062a4cc7d0 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:44.426953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:44.428011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:44.428472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:44.428883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] PATH_INFO: `/v3/projects/e77d53ee32f74dc587daaca60af07dc1/users/136cee62cd5e43ed98f14b8b172ad62f/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:44.446403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77d53ee32f74dc587daaca60af07dc1, user_id=136cee62cd5e43ed98f14b8b172ad62f, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:44.449332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:44.470420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 834/1667] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:44 2022] PUT /identity/v3/projects/e77d53ee32f74dc587daaca60af07dc1/users/136cee62cd5e43ed98f14b8b172ad62f/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:44.471800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:44.475649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:44.574634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c09a-6295-4d0c-85f3-0b56f3b6b7bd admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:44.595322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9dcb5-fda4-4baf-986e-d98c7a0c60f4 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:44.608895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13310e-0659-480d-87d5-2878e7a51175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:44.609668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13310e-0659-480d-87d5-2878e7a51175 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:44.610050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13310e-0659-480d-87d5-2878e7a51175 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:44.610477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13310e-0659-480d-87d5-2878e7a51175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:44.655634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:44.684058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:44.684930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:44.685384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:44.685825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:44.688452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:44.700467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:44.757754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13310e-0659-480d-87d5-2878e7a51175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:44.760652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13310e-0659-480d-87d5-2878e7a51175 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:44.769799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:44.772204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:44.788797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 835/1668] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:44.789944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13310e-0659-480d-87d5-2878e7a51175 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:44.794465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 834/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:44.811001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13310e-0659-480d-87d5-2878e7a51175 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:44.827884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad99dfa-d1e0-47c9-aa77-6c3ec76f9088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:44.828824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad99dfa-d1e0-47c9-aa77-6c3ec76f9088 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:44.829239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad99dfa-d1e0-47c9-aa77-6c3ec76f9088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:44.829650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad99dfa-d1e0-47c9-aa77-6c3ec76f9088 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:44.830685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad99dfa-d1e0-47c9-aa77-6c3ec76f9088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:44.835841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad99dfa-d1e0-47c9-aa77-6c3ec76f9088 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:44.861748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 836/1670] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:44.865957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:44.883906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571c1de-8755-4e74-9c52-cd496868d29c service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:44.903327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:44.904216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:44.904506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:44.904995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] PATH_INFO: `/v3/projects/e77d53ee32f74dc587daaca60af07dc1/users/136cee62cd5e43ed98f14b8b172ad62f/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:44.907918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77d53ee32f74dc587daaca60af07dc1, user_id=136cee62cd5e43ed98f14b8b172ad62f, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:44.912148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:44.946729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 835/1671] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:44 2022] PUT /identity/v3/projects/e77d53ee32f74dc587daaca60af07dc1/users/136cee62cd5e43ed98f14b8b172ad62f/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:44.957038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334f5f-9242-484d-937a-b9a74566563b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:44.958093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334f5f-9242-484d-937a-b9a74566563b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:44.958613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334f5f-9242-484d-937a-b9a74566563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:45.025447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d9334f5f-9242-484d-937a-b9a74566563b None None] MFA Rules not processed for user `136cee62cd5e43ed98f14b8b172ad62f`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:45.027367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d9334f5f-9242-484d-937a-b9a74566563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:45.169491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 837/1672] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:45.181650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:45.183665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:45.337037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c44a4-25b7-4aff-af76-34263594c7eb admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:45.350362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:45.351888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:45.353573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:45.353959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:45.378827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:45.388433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:45.423436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 836/1673] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:45.609463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9334f5f-9242-484d-937a-b9a74566563b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:45.626824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9334f5f-9242-484d-937a-b9a74566563b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:45.638579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:45.640521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:45.648961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc31bc-6759-458e-b85c-ac0475215707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:45.649952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc31bc-6759-458e-b85c-ac0475215707 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:45.650359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc31bc-6759-458e-b85c-ac0475215707 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:45.654267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc31bc-6759-458e-b85c-ac0475215707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:45.657006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f2fc31bc-6759-458e-b85c-ac0475215707 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:45.792315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc31bc-6759-458e-b85c-ac0475215707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:45.796655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc31bc-6759-458e-b85c-ac0475215707 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:45.826341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401435a-ad85-439d-a79c-34b85209bf7a service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:45.838848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 838/1674] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:45.839655 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:45.840561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:45.841008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:45.841386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] PATH_INFO: `/v3/users/41631422a99049828b6f3845f8d508b7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:45.842826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41631422a99049828b6f3845f8d508b7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:45.844847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:45.970429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:45.989761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41631422a99049828b6f3845f8d508b7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:46.012098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41631422a99049828b6f3845f8d508b7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:46.012406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41631422a99049828b6f3845f8d508b7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:46.030196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41631422a99049828b6f3845f8d508b7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:46.074136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41631422a99049828b6f3845f8d508b7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:46.085557 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 837/1675] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:28:45 2022] DELETE /identity/v3/users/41631422a99049828b6f3845f8d508b7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:28:46.091192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a96d-c1fc-4c78-9a21-72a7260c888d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:46.092227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a96d-c1fc-4c78-9a21-72a7260c888d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:46.093529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a96d-c1fc-4c78-9a21-72a7260c888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:46.152052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-eaf7a96d-c1fc-4c78-9a21-72a7260c888d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:46.159371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-eaf7a96d-c1fc-4c78-9a21-72a7260c888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:46.245937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:46.356363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 839/1676] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:46.387834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:46.390545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:46.563525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc42044-5400-4b36-8113-34500b3347a4 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:46.578818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe1e9-48ed-4f8d-9009-e641a49d9392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:46.579936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1e9-48ed-4f8d-9009-e641a49d9392 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:46.580266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1e9-48ed-4f8d-9009-e641a49d9392 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:46.580544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1e9-48ed-4f8d-9009-e641a49d9392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:46.605729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbe1e9-48ed-4f8d-9009-e641a49d9392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:46.610201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbe1e9-48ed-4f8d-9009-e641a49d9392 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:46.651871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 838/1677] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:47.344915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2db86-9510-4dff-9aec-e20a74068600 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:47.345434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2db86-9510-4dff-9aec-e20a74068600 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:47.345619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2db86-9510-4dff-9aec-e20a74068600 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:47.347033 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 840/1678] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 8 00:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:28:47.356415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80b99-61d9-4a94-9e4d-e441b6a08d11 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:47.357477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80b99-61d9-4a94-9e4d-e441b6a08d11 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:47.357477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80b99-61d9-4a94-9e4d-e441b6a08d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:47.440023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-0fe80b99-61d9-4a94-9e4d-e441b6a08d11 None None] MFA Rules not processed for user `17a501a048ed4b6c8186bfd490ad1394`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:47.441260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0fe80b99-61d9-4a94-9e4d-e441b6a08d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:47.458252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 839/1679] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:28:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:28:47.490296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2db86-9510-4dff-9aec-e20a74068600 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:47.492738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-33d2db86-9510-4dff-9aec-e20a74068600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:47.523653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2db86-9510-4dff-9aec-e20a74068600 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:47.534011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3368571-4061-475e-a18f-15817d1a2cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:47.534761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368571-4061-475e-a18f-15817d1a2cae service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:47.535049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368571-4061-475e-a18f-15817d1a2cae service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:47.535325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368571-4061-475e-a18f-15817d1a2cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:47.560908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3368571-4061-475e-a18f-15817d1a2cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:47.563414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3368571-4061-475e-a18f-15817d1a2cae service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:47.588602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 841/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:47.762491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe80b99-61d9-4a94-9e4d-e441b6a08d11 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:47.764777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0fe80b99-61d9-4a94-9e4d-e441b6a08d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:47.804666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe80b99-61d9-4a94-9e4d-e441b6a08d11 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:47.823914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:47.825254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:47.826820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:47.827384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] PATH_INFO: `/v3/projects/73c2f294f52343bcb172dd7f2e9ae8ca` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:47.832392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c2f294f52343bcb172dd7f2e9ae8ca)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:47.839024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:47.927420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b70b-43f5-49d5-a3dd-62bfd75260fd None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:47.928254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b70b-43f5-49d5-a3dd-62bfd75260fd None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:47.928818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b70b-43f5-49d5-a3dd-62bfd75260fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:48.036803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9614b70b-43f5-49d5-a3dd-62bfd75260fd None None] MFA Rules not processed for user `d96cd2348dc14beeb6fafe55db57c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:48.039863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9614b70b-43f5-49d5-a3dd-62bfd75260fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:48.057441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c2f294f52343bcb172dd7f2e9ae8ca', 'request_id': 'req-e1a13e50-8e0e-4bb5-b656-11059e8d74af'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.073015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c2f294f52343bcb172dd7f2e9ae8ca', 'request_id': 'req-e1a13e50-8e0e-4bb5-b656-11059e8d74af'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.084092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c2f294f52343bcb172dd7f2e9ae8ca', 'request_id': 'req-e1a13e50-8e0e-4bb5-b656-11059e8d74af'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.112864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] The token cache is being invalidate because project 73c2f294f52343bcb172dd7f2e9ae8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:28:48.113322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.114536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.120356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 840/1681] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:28:47 2022] DELETE /identity/v3/projects/73c2f294f52343bcb172dd7f2e9ae8ca => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:48.127910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:48.131168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:48.206891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 842/1682] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:48.208812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653de7-b4e3-4145-b0ff-fe4266757a46 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:48.209117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653de7-b4e3-4145-b0ff-fe4266757a46 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:48.209428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653de7-b4e3-4145-b0ff-fe4266757a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:48.255873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d5653de7-b4e3-4145-b0ff-fe4266757a46 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:48.257552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d5653de7-b4e3-4145-b0ff-fe4266757a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:48.274179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:48.380207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13e50-8e0e-4bb5-b656-11059e8d74af admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:48.386096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:48.387352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:48.387872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:48.388348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] PATH_INFO: `/v3/projects/b17f191721bd4fef9cc0df6eb1d450ef` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:48.390112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17f191721bd4fef9cc0df6eb1d450ef)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:48.403448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:48.420061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 843/1683] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:48.420061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16630834-9545-4c63-ad2e-c470a85be0d4 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:48.420061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16630834-9545-4c63-ad2e-c470a85be0d4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:48.420061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16630834-9545-4c63-ad2e-c470a85be0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:48.450798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-16630834-9545-4c63-ad2e-c470a85be0d4 None None] MFA Rules not processed for user `d96cd2348dc14beeb6fafe55db57c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:48.452072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-16630834-9545-4c63-ad2e-c470a85be0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:48.461831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 844/1684] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:48.467391 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344a24-8f1f-44a3-bff1-790777a6009b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:48.467708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344a24-8f1f-44a3-bff1-790777a6009b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:48.467955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344a24-8f1f-44a3-bff1-790777a6009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:48.502438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-42344a24-8f1f-44a3-bff1-790777a6009b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:48.503779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-42344a24-8f1f-44a3-bff1-790777a6009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:48.530643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 845/1685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:48.530643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42344a24-8f1f-44a3-bff1-790777a6009b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:48.536669 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-42344a24-8f1f-44a3-bff1-790777a6009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:48.543180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17f191721bd4fef9cc0df6eb1d450ef', 'request_id': 'req-73c8acad-aa0f-41d5-be77-8a31240960b1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.560901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17f191721bd4fef9cc0df6eb1d450ef', 'request_id': 'req-73c8acad-aa0f-41d5-be77-8a31240960b1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.578456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17f191721bd4fef9cc0df6eb1d450ef', 'request_id': 'req-73c8acad-aa0f-41d5-be77-8a31240960b1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.604027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] The token cache is being invalidate because project b17f191721bd4fef9cc0df6eb1d450ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:28:48.604367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.606535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:48.609493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 841/1686] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:28:48 2022] DELETE /identity/v3/projects/b17f191721bd4fef9cc0df6eb1d450ef => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:48.610399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:48.612975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:48.617017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:48.748030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42344a24-8f1f-44a3-bff1-790777a6009b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:48.776641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8acad-aa0f-41d5-be77-8a31240960b1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:48.789844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:48.790550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:48.790843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:48.791122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:48.791783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:48.792089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:48.796076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:48.826773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 842/1687] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:48.831668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:48.839033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:48.867351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca06700-61c1-4156-b39e-195eb81ebe0b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:48.880222 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:48.880843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:48.881131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:48.881409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] PATH_INFO: `/v3/users/50a004ac37fa434cb3dd6993e0b3d059` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:48.882732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a004ac37fa434cb3dd6993e0b3d059)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:48.888606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:48.903278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:48.905729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:48.906135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:48.906496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:48.913312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:49.030216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:49.040179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a004ac37fa434cb3dd6993e0b3d059'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:49.060453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a004ac37fa434cb3dd6993e0b3d059'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:49.062055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a004ac37fa434cb3dd6993e0b3d059'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:49.083971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:49.086471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:49.099307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a004ac37fa434cb3dd6993e0b3d059'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:49.114895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 846/1688] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:49.115988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:49.138946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a004ac37fa434cb3dd6993e0b3d059'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:49.157167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fa797-7823-4cd5-a79e-b7bd8fe6736d service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:49.167209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 843/1689] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:28:48 2022] DELETE /identity/v3/users/50a004ac37fa434cb3dd6993e0b3d059 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:49.189416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f63987-e3b1-4689-aa33-1b9d9cc5cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:49.190059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f63987-e3b1-4689-aa33-1b9d9cc5cf07 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:49.190321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f63987-e3b1-4689-aa33-1b9d9cc5cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:49.190599 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f63987-e3b1-4689-aa33-1b9d9cc5cf07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:49.191695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f63987-e3b1-4689-aa33-1b9d9cc5cf07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:49.208968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f63987-e3b1-4689-aa33-1b9d9cc5cf07 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:49.298334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 847/1690] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:49 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:49.302613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:49.304321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:49.481612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296212a3-8dcc-4a0d-9f95-915245d83321 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:49.482552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296212a3-8dcc-4a0d-9f95-915245d83321 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:49.483040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296212a3-8dcc-4a0d-9f95-915245d83321 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:49.484564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 848/1691] 10.222.0.23 () {54 vars in 961 bytes} [Mon Aug 8 00:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:28:49.503075 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff6473-aee7-4073-999e-9f6a35a8ad48 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:49.503370 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff6473-aee7-4073-999e-9f6a35a8ad48 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:49.503692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff6473-aee7-4073-999e-9f6a35a8ad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:49.530430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9ecc2-8362-4f38-be04-4a4d8075d73a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:49.584794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-72ff6473-aee7-4073-999e-9f6a35a8ad48 None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:49.588537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-72ff6473-aee7-4073-999e-9f6a35a8ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:49.689708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd4dee-c57d-46d1-94db-6658b8337ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:49.690542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4dee-c57d-46d1-94db-6658b8337ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:49.690784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4dee-c57d-46d1-94db-6658b8337ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:49.691045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4dee-c57d-46d1-94db-6658b8337ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:49.691632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd4dee-c57d-46d1-94db-6658b8337ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:49.694182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd4dee-c57d-46d1-94db-6658b8337ab7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:49.702100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:49.762920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 844/1692] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:49 2022] POST /identity/v3/users => generated 283 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:49.769749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd4dee-c57d-46d1-94db-6658b8337ab7 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:49.769962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 849/1693] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Aug 8 00:28:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:49.778533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff6473-aee7-4073-999e-9f6a35a8ad48 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:49.792286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd4dee-c57d-46d1-94db-6658b8337ab7 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:49.801443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794be44-ecda-455c-b09a-7596c37a285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:49.801753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794be44-ecda-455c-b09a-7596c37a285a admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:49.802181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794be44-ecda-455c-b09a-7596c37a285a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:49.802474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff6473-aee7-4073-999e-9f6a35a8ad48 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:49.802646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794be44-ecda-455c-b09a-7596c37a285a admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:49.803507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794be44-ecda-455c-b09a-7596c37a285a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:49.805268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794be44-ecda-455c-b09a-7596c37a285a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:49.825183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 845/1694] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:49.831265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:49.832081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:49.832285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:49.833199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:49.835288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:49.855945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794be44-ecda-455c-b09a-7596c37a285a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:49.870360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:49.871873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:49.884810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794be44-ecda-455c-b09a-7596c37a285a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:49.885011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 850/1695] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:49.896732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb62898-59c4-43ef-be8b-5e97dc3a701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:49.897494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb62898-59c4-43ef-be8b-5e97dc3a701b admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:49.897841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb62898-59c4-43ef-be8b-5e97dc3a701b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:49.898257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb62898-59c4-43ef-be8b-5e97dc3a701b admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:49.899350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb62898-59c4-43ef-be8b-5e97dc3a701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:49.900823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb62898-59c4-43ef-be8b-5e97dc3a701b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:49.925644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 846/1696] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:49.931885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:49.948165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00c7aa-4736-4a0c-924d-3d8abd737a3d service placement] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:49.955059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1da9-c7bb-4016-932e-e389859479dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:49.955936 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1da9-c7bb-4016-932e-e389859479dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:49.956411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1da9-c7bb-4016-932e-e389859479dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:49.956856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1da9-c7bb-4016-932e-e389859479dd admin admin] PATH_INFO: `/v3/projects/bdbd1ecf7c5e44edb47c1ca45d474670/users/0cf45dd584254163a1781ae0fe56a174/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:49.981939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1da9-c7bb-4016-932e-e389859479dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbd1ecf7c5e44edb47c1ca45d474670, user_id=0cf45dd584254163a1781ae0fe56a174, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:49.985863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1da9-c7bb-4016-932e-e389859479dd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:50.031279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 851/1697] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:49 2022] PUT /identity/v3/projects/bdbd1ecf7c5e44edb47c1ca45d474670/users/0cf45dd584254163a1781ae0fe56a174/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:50.035288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b785c-683e-41ad-a030-d49bffff32c1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:50.035690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b785c-683e-41ad-a030-d49bffff32c1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:50.036063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b785c-683e-41ad-a030-d49bffff32c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:50.108232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-9b2b785c-683e-41ad-a030-d49bffff32c1 None None] MFA Rules not processed for user `0cf45dd584254163a1781ae0fe56a174`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:50.111731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9b2b785c-683e-41ad-a030-d49bffff32c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:50.177183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:50.316383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 847/1698] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:50.321199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1da9-c7bb-4016-932e-e389859479dd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:50.398178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c5c62-8237-4063-a499-b3959906a6b7 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:50.398539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c5c62-8237-4063-a499-b3959906a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:50.398820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c5c62-8237-4063-a499-b3959906a6b7 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:50.404358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 848/1699] 10.222.0.23 () {54 vars in 912 bytes} [Mon Aug 8 00:28:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:28:50.410162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17938fb4-fbe1-4c8c-8ffb-cb694ab4739c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:50.410456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17938fb4-fbe1-4c8c-8ffb-cb694ab4739c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:50.411262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17938fb4-fbe1-4c8c-8ffb-cb694ab4739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:50.464700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-17938fb4-fbe1-4c8c-8ffb-cb694ab4739c None None] MFA Rules not processed for user `17a501a048ed4b6c8186bfd490ad1394`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:50.467523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-17938fb4-fbe1-4c8c-8ffb-cb694ab4739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:50.477914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1da9-c7bb-4016-932e-e389859479dd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:50.510253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e033-c92f-4672-9979-abeb85e2e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:50.514055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e033-c92f-4672-9979-abeb85e2e830 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:50.514709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e033-c92f-4672-9979-abeb85e2e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:50.516529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e033-c92f-4672-9979-abeb85e2e830 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:50.521078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e033-c92f-4672-9979-abeb85e2e830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:50.537380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e033-c92f-4672-9979-abeb85e2e830 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:50.673474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 852/1700] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:50 2022] POST /identity/v3/projects => generated 365 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:50.675743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6c12-127e-46c5-bbf2-093f4da63ec7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:50.676802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6c12-127e-46c5-bbf2-093f4da63ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:50.677427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6c12-127e-46c5-bbf2-093f4da63ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:50.708751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 849/1701] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:50.709877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17938fb4-fbe1-4c8c-8ffb-cb694ab4739c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:50.741261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8a7c6c12-127e-46c5-bbf2-093f4da63ec7 None None] MFA Rules not processed for user `8c1dd80884d842669997cdb306ce0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:50.743877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8a7c6c12-127e-46c5-bbf2-093f4da63ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:50.746770 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17938fb4-fbe1-4c8c-8ffb-cb694ab4739c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:50.963883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:50.964479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:50.964691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:50.964986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:50.968628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:50.972083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:50.976797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 853/1702] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:50.989687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c6c12-127e-46c5-bbf2-093f4da63ec7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:50.993661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8a7c6c12-127e-46c5-bbf2-093f4da63ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:51.059352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 850/1703] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:50 2022] POST /identity/v3/users => generated 289 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:51.061492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:51.067175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:51.080861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:51.240556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c6c12-127e-46c5-bbf2-093f4da63ec7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:51.250403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58750b3-525b-4783-9930-199fd39bbcf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:51.253487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58750b3-525b-4783-9930-199fd39bbcf5 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:51.253807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58750b3-525b-4783-9930-199fd39bbcf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:51.254228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58750b3-525b-4783-9930-199fd39bbcf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:51.278152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58750b3-525b-4783-9930-199fd39bbcf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:51.284930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58750b3-525b-4783-9930-199fd39bbcf5 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:51.308300 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 854/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:51.309044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58750b3-525b-4783-9930-199fd39bbcf5 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:51.321721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:51.351742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e0e3-aa44-4518-b75f-2128fe910d86 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:51.358806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58750b3-525b-4783-9930-199fd39bbcf5 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:51.373060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:51.373709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:51.374751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d0413-bcb2-49cd-a93b-32bdfa8095d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:51.375024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:51.375322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:51.376629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d0413-bcb2-49cd-a93b-32bdfa8095d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:51.376917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d0413-bcb2-49cd-a93b-32bdfa8095d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:51.377598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d0413-bcb2-49cd-a93b-32bdfa8095d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:51.380029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d0413-bcb2-49cd-a93b-32bdfa8095d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:51.386194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d0413-bcb2-49cd-a93b-32bdfa8095d8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:51.402811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:51.408972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:51.420322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 855/1705] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:51.424071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d0413-bcb2-49cd-a93b-32bdfa8095d8 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:51.440337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 851/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:51.447825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:51.451029 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:51.451273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d0413-bcb2-49cd-a93b-32bdfa8095d8 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:51.470048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40dbf7-a1c6-4ff9-b055-ee4764a304cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:51.471147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40dbf7-a1c6-4ff9-b055-ee4764a304cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:51.471639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40dbf7-a1c6-4ff9-b055-ee4764a304cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:51.472181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40dbf7-a1c6-4ff9-b055-ee4764a304cf admin admin] PATH_INFO: `/v3/projects/092380cab4f340bc9c22f050dad16487/users/f8feec3002f04a649062313c7be8862b/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:51.477528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c27cc-7961-4ae4-b463-33d8bd4d5aee service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:51.490293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:51.500031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:51.503477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40dbf7-a1c6-4ff9-b055-ee4764a304cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=092380cab4f340bc9c22f050dad16487, user_id=f8feec3002f04a649062313c7be8862b, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:51.508984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:51.509190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40dbf7-a1c6-4ff9-b055-ee4764a304cf admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:51.509292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] PATH_INFO: `/v3/users/a94e47f91ff04f9abe6db946a646e3f1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:51.510508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94e47f91ff04f9abe6db946a646e3f1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:51.513228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:51.545317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 856/1707] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:51 2022] PUT /identity/v3/projects/092380cab4f340bc9c22f050dad16487/users/f8feec3002f04a649062313c7be8862b/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:51.547444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40dbf7-a1c6-4ff9-b055-ee4764a304cf admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:51.647678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94e47f91ff04f9abe6db946a646e3f1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:51.662365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94e47f91ff04f9abe6db946a646e3f1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:51.663080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94e47f91ff04f9abe6db946a646e3f1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:51.680141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94e47f91ff04f9abe6db946a646e3f1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:51.718611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94e47f91ff04f9abe6db946a646e3f1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:51.752026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 852/1708] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:28:51 2022] DELETE /identity/v3/users/a94e47f91ff04f9abe6db946a646e3f1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:51.752026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:51.753121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:51.757025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40dbf7-a1c6-4ff9-b055-ee4764a304cf admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:51.962845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4daa9c-b8f9-4dfa-8e1f-1cdcd59270da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:51.963403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4daa9c-b8f9-4dfa-8e1f-1cdcd59270da admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:51.963684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4daa9c-b8f9-4dfa-8e1f-1cdcd59270da admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:51.963965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4daa9c-b8f9-4dfa-8e1f-1cdcd59270da admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:51.964621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4daa9c-b8f9-4dfa-8e1f-1cdcd59270da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:51.970345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4daa9c-b8f9-4dfa-8e1f-1cdcd59270da admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:51.972551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df442-a951-4f06-893f-94a66d700dd6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:51.987915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:51.990822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:51.991110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:51.991393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] PATH_INFO: `/v3/projects/261c93fd3b2046cbb91498d4879216c4` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:51.994273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261c93fd3b2046cbb91498d4879216c4)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:51.996042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 857/1709] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:51.997431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc4e2-129e-4ec9-87f2-e2d4ed9ec868 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:51.997725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc4e2-129e-4ec9-87f2-e2d4ed9ec868 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:51.998001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc4e2-129e-4ec9-87f2-e2d4ed9ec868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:51.998539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:52.064703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-27ddc4e2-129e-4ec9-87f2-e2d4ed9ec868 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:52.065991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-27ddc4e2-129e-4ec9-87f2-e2d4ed9ec868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:52.099356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 858/1710] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:52.099356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc4e2-129e-4ec9-87f2-e2d4ed9ec868 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:52.111543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-27ddc4e2-129e-4ec9-87f2-e2d4ed9ec868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:52.183414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc4e2-129e-4ec9-87f2-e2d4ed9ec868 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:52.192970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261c93fd3b2046cbb91498d4879216c4', 'request_id': 'req-723843bd-3926-4e0e-b63f-37ec6b67f2a7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:52.217221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261c93fd3b2046cbb91498d4879216c4', 'request_id': 'req-723843bd-3926-4e0e-b63f-37ec6b67f2a7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:52.232903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261c93fd3b2046cbb91498d4879216c4', 'request_id': 'req-723843bd-3926-4e0e-b63f-37ec6b67f2a7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:52.240263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:52.249332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:52.285799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] The token cache is being invalidate because project 261c93fd3b2046cbb91498d4879216c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:28:52.285799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:52.287803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:52.290187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 853/1711] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:28:51 2022] DELETE /identity/v3/projects/261c93fd3b2046cbb91498d4879216c4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:52.298533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:52.308657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:52.359930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a6e3b-f7cf-41c6-ae21-485d0c5b3f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:52.360993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6e3b-f7cf-41c6-ae21-485d0c5b3f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:52.361464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6e3b-f7cf-41c6-ae21-485d0c5b3f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:52.361925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6e3b-f7cf-41c6-ae21-485d0c5b3f60 admin admin] PATH_INFO: `/v3/projects/092380cab4f340bc9c22f050dad16487/users/f8feec3002f04a649062313c7be8862b/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:52.366757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a6e3b-f7cf-41c6-ae21-485d0c5b3f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092380cab4f340bc9c22f050dad16487, user_id=f8feec3002f04a649062313c7be8862b, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:52.377493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a6e3b-f7cf-41c6-ae21-485d0c5b3f60 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:52.414156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 859/1712] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:52 2022] PUT /identity/v3/projects/092380cab4f340bc9c22f050dad16487/users/f8feec3002f04a649062313c7be8862b/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:52.420520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bc34-4506-4dae-b361-87b885612ca1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:52.427656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bc34-4506-4dae-b361-87b885612ca1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:52.428230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bc34-4506-4dae-b361-87b885612ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:52.479844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4285bc34-4506-4dae-b361-87b885612ca1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:52.483093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4285bc34-4506-4dae-b361-87b885612ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:52.485282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723843bd-3926-4e0e-b63f-37ec6b67f2a7 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:52.681074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe110fc-d6ab-4dac-ba51-94d0ae85394d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:52.681717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe110fc-d6ab-4dac-ba51-94d0ae85394d service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:52.681996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe110fc-d6ab-4dac-ba51-94d0ae85394d service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:52.682303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe110fc-d6ab-4dac-ba51-94d0ae85394d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:52.703201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9fe110fc-d6ab-4dac-ba51-94d0ae85394d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:52.754336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 860/1713] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:52.754336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052a0a-0207-4796-973f-857f671ef3d6 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:52.754977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052a0a-0207-4796-973f-857f671ef3d6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:52.754977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052a0a-0207-4796-973f-857f671ef3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:52.858273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b4052a0a-0207-4796-973f-857f671ef3d6 None None] MFA Rules not processed for user `f8feec3002f04a649062313c7be8862b`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:52.858273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b4052a0a-0207-4796-973f-857f671ef3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:52.899235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe110fc-d6ab-4dac-ba51-94d0ae85394d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:52.901808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe110fc-d6ab-4dac-ba51-94d0ae85394d service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:52.926802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 854/1714] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:52.926802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1a02-d6e5-4b81-aff5-10d5df733543 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:52.927085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1a02-d6e5-4b81-aff5-10d5df733543 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:52.927630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1a02-d6e5-4b81-aff5-10d5df733543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:52.995846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-93ab1a02-d6e5-4b81-aff5-10d5df733543 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:52.997154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-93ab1a02-d6e5-4b81-aff5-10d5df733543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:53.024960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 855/1715] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:53.033050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf89e5-6de4-4e2f-9333-03d038a9b1d8 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:53.033367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf89e5-6de4-4e2f-9333-03d038a9b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:53.034308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf89e5-6de4-4e2f-9333-03d038a9b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:53.100840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-9bcf89e5-6de4-4e2f-9333-03d038a9b1d8 None None] MFA Rules not processed for user `17cc8db0bbd24c4098931f2c53381751`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:53.102109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9bcf89e5-6de4-4e2f-9333-03d038a9b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:53.165825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 861/1716] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:53.171441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0cec0-cf97-4442-a56a-a4309c4ed217 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:53.171441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0cec0-cf97-4442-a56a-a4309c4ed217 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:53.171441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0cec0-cf97-4442-a56a-a4309c4ed217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:53.282511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bee0cec0-cf97-4442-a56a-a4309c4ed217 None None] MFA Rules not processed for user `3e3151bac78942a69fb3764d5ef3814c`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:53.284117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bee0cec0-cf97-4442-a56a-a4309c4ed217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:53.305091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:53.345509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:53.410724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 856/1717] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:53.411363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf89e5-6de4-4e2f-9333-03d038a9b1d8 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:53.443111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 862/1718] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:53.445185 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26642-a35c-4b93-9ccf-91139cd23b59 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:53.445699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26642-a35c-4b93-9ccf-91139cd23b59 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:53.446275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26642-a35c-4b93-9ccf-91139cd23b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:53.448936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf89e5-6de4-4e2f-9333-03d038a9b1d8 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:53.469517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:53.469517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:53.469517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:53.469517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:53.470192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:28:53.470507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:53.472184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:53.485317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d2e26642-a35c-4b93-9ccf-91139cd23b59 None None] MFA Rules not processed for user `d96cd2348dc14beeb6fafe55db57c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:53.488275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d2e26642-a35c-4b93-9ccf-91139cd23b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:53.534275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 857/1719] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:28:53.536504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:53.542454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:53.673279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 863/1720] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:53.676741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e26642-a35c-4b93-9ccf-91139cd23b59 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:53.680845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d2e26642-a35c-4b93-9ccf-91139cd23b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:53.714443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e68d-5bc4-4f2f-9282-a3ab7d44e0dc admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:53.725285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364044-3986-43f8-b447-36c706d7b3c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:53.725913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364044-3986-43f8-b447-36c706d7b3c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:53.727657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364044-3986-43f8-b447-36c706d7b3c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:53.729475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364044-3986-43f8-b447-36c706d7b3c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:53.756691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364044-3986-43f8-b447-36c706d7b3c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:53.761674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364044-3986-43f8-b447-36c706d7b3c6 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:53.797918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 858/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:53.799479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364044-3986-43f8-b447-36c706d7b3c6 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:53.827932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364044-3986-43f8-b447-36c706d7b3c6 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:53.845752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a96-6edc-4252-a45a-47a25bda506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:53.848075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a96-6edc-4252-a45a-47a25bda506e admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:53.864728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a96-6edc-4252-a45a-47a25bda506e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:53.865053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a96-6edc-4252-a45a-47a25bda506e admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:53.867937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0321a96-6edc-4252-a45a-47a25bda506e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:53.873910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0321a96-6edc-4252-a45a-47a25bda506e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:53.916336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e26642-a35c-4b93-9ccf-91139cd23b59 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:53.936135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6c481-e805-44bc-ac89-ed484edc1f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:53.937713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c481-e805-44bc-ac89-ed484edc1f9f service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:53.938619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c481-e805-44bc-ac89-ed484edc1f9f service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:53.938954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c481-e805-44bc-ac89-ed484edc1f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:53.945315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 859/1722] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:53 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:53.949847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a96-6edc-4252-a45a-47a25bda506e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:53.966982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6c481-e805-44bc-ac89-ed484edc1f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:53.984746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6c481-e805-44bc-ac89-ed484edc1f9f service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:54.035780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 864/1723] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:54.037198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6c481-e805-44bc-ac89-ed484edc1f9f service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:54.086861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6c481-e805-44bc-ac89-ed484edc1f9f service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:54.147440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a96-6edc-4252-a45a-47a25bda506e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:54.170442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bea96f-3fc7-43f4-8582-5639dec83dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:54.175615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bea96f-3fc7-43f4-8582-5639dec83dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:54.178372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bea96f-3fc7-43f4-8582-5639dec83dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:54.179229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bea96f-3fc7-43f4-8582-5639dec83dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:54.195336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bea96f-3fc7-43f4-8582-5639dec83dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:54.211868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bea96f-3fc7-43f4-8582-5639dec83dd2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:54.253665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:54.255197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:54.256103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:54.258341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:54.264788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:54.290792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 860/1724] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:53 2022] POST /identity/v3/users => generated 284 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:54.294443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4915b4-1f0d-4cae-94f9-ff2d9a062f96 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:54.294740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4915b4-1f0d-4cae-94f9-ff2d9a062f96 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:54.296336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4915b4-1f0d-4cae-94f9-ff2d9a062f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:54.340207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:54.497027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-4b4915b4-1f0d-4cae-94f9-ff2d9a062f96 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:54.497914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4b4915b4-1f0d-4cae-94f9-ff2d9a062f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:54.500740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:54.503084 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:54.522261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 865/1725] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:54.523675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:54.544811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:54.725333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 861/1726] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:28:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:54.726274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4915b4-1f0d-4cae-94f9-ff2d9a062f96 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:54.729329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4b4915b4-1f0d-4cae-94f9-ff2d9a062f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:54.751591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a723f-2e77-42a4-a9a9-b81a6853d677 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:54.770008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749975b-0062-4db0-9837-d3d4f64f4b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:54.770775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749975b-0062-4db0-9837-d3d4f64f4b42 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:54.770976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749975b-0062-4db0-9837-d3d4f64f4b42 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:54.771207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749975b-0062-4db0-9837-d3d4f64f4b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:54.784937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4915b4-1f0d-4cae-94f9-ff2d9a062f96 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:54.806939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:54.807611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:54.807880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:54.808153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] PATH_INFO: `/v3/projects/077a90d479e44e6d8d2b51699c9b562c` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:54.810654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=077a90d479e44e6d8d2b51699c9b562c)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:54.813013 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:54.985506 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749975b-0062-4db0-9837-d3d4f64f4b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:54.992965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749975b-0062-4db0-9837-d3d4f64f4b42 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:55.009850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077a90d479e44e6d8d2b51699c9b562c', 'request_id': 'req-2fc50fe3-933b-47d6-b225-a82abddcfe89'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.015180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 866/1727] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:55.021432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749975b-0062-4db0-9837-d3d4f64f4b42 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:55.024166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077a90d479e44e6d8d2b51699c9b562c', 'request_id': 'req-2fc50fe3-933b-47d6-b225-a82abddcfe89'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.034659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077a90d479e44e6d8d2b51699c9b562c', 'request_id': 'req-2fc50fe3-933b-47d6-b225-a82abddcfe89'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.048243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749975b-0062-4db0-9837-d3d4f64f4b42 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:55.062221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] The token cache is being invalidate because project 077a90d479e44e6d8d2b51699c9b562c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:28:55.063992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.066464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.074179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 862/1728] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:28:54 2022] DELETE /identity/v3/projects/077a90d479e44e6d8d2b51699c9b562c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:55.078888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:55.084099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:55.227395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:55.239006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:55.241227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:55.241815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:55.242381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:55.243395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:55.247264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:55.270874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 867/1729] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:55.272822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:55.280451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:55.311724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f32c53-ccea-4551-ae94-4ca61433d3e1 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:55.334920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:55.335593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:55.335875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:55.336149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] PATH_INFO: `/v3/users/136cee62cd5e43ed98f14b8b172ad62f` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:55.342873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136cee62cd5e43ed98f14b8b172ad62f)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:55.344869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:55.349183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50fe3-933b-47d6-b225-a82abddcfe89 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:55.354729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:55.355345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:55.355629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:55.355905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:55.365905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:55.388476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:55.460148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136cee62cd5e43ed98f14b8b172ad62f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.480365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136cee62cd5e43ed98f14b8b172ad62f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.481138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136cee62cd5e43ed98f14b8b172ad62f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.481780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136cee62cd5e43ed98f14b8b172ad62f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.513044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136cee62cd5e43ed98f14b8b172ad62f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:28:55.554160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 868/1730] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:28:55 2022] DELETE /identity/v3/users/136cee62cd5e43ed98f14b8b172ad62f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:55.555058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:55.564785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:55.589164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:55.595102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:55.641561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 863/1731] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:28:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:28:55.776343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93419c0b-642c-4364-923f-4e13e22f6046 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:55.806386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce00011-32fe-43d1-9ded-b54a8cfb4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:55.806954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce00011-32fe-43d1-9ded-b54a8cfb4fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:55.807282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce00011-32fe-43d1-9ded-b54a8cfb4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:55.807556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce00011-32fe-43d1-9ded-b54a8cfb4fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:55.808215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce00011-32fe-43d1-9ded-b54a8cfb4fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:55.809891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce00011-32fe-43d1-9ded-b54a8cfb4fc5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:55.847426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 869/1732] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:55.851420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:55.853404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:55.918030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de9651-8608-468d-bf0b-ea13cec9bbae service swift] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:55.939041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a524f7-6592-4c4a-ba23-7acfc5547f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:55.939733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a524f7-6592-4c4a-ba23-7acfc5547f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:55.940016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a524f7-6592-4c4a-ba23-7acfc5547f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:55.940296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a524f7-6592-4c4a-ba23-7acfc5547f27 admin admin] PATH_INFO: `/v3/projects/714dd6c44b45488ba232f43bbb1b7e74/users/99e6acf77760480bae3dcf268bacc7c6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:55.990529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a524f7-6592-4c4a-ba23-7acfc5547f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714dd6c44b45488ba232f43bbb1b7e74, user_id=99e6acf77760480bae3dcf268bacc7c6, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:55.993949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a524f7-6592-4c4a-ba23-7acfc5547f27 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:56.103642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 864/1733] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:55 2022] PUT /identity/v3/projects/714dd6c44b45488ba232f43bbb1b7e74/users/99e6acf77760480bae3dcf268bacc7c6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:56.104222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984eb27-5fae-4119-ad7e-15cbaa5a8f21 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:56.104708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984eb27-5fae-4119-ad7e-15cbaa5a8f21 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:56.104786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984eb27-5fae-4119-ad7e-15cbaa5a8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:56.201810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-0984eb27-5fae-4119-ad7e-15cbaa5a8f21 None None] MFA Rules not processed for user `99e6acf77760480bae3dcf268bacc7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:56.211160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0984eb27-5fae-4119-ad7e-15cbaa5a8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:56.390723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:56.497345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 870/1734] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:28:56.506141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a524f7-6592-4c4a-ba23-7acfc5547f27 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:56.742949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a524f7-6592-4c4a-ba23-7acfc5547f27 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:56.758727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f1aac-d299-4de5-bc7c-385b55f037c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:56.760509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1aac-d299-4de5-bc7c-385b55f037c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:56.760797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1aac-d299-4de5-bc7c-385b55f037c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:56.761081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1aac-d299-4de5-bc7c-385b55f037c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:56.763866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f1aac-d299-4de5-bc7c-385b55f037c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:56.768977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f1aac-d299-4de5-bc7c-385b55f037c4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:56.868150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984eb27-5fae-4119-ad7e-15cbaa5a8f21 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:56.880362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 865/1735] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:28:56 2022] POST /identity/v3/projects => generated 367 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:56.888353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984eb27-5fae-4119-ad7e-15cbaa5a8f21 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:57.243383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269db72a-b0b9-4bc5-a9f6-d1c5a7cfb826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:57.246471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db72a-b0b9-4bc5-a9f6-d1c5a7cfb826 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:57.246791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db72a-b0b9-4bc5-a9f6-d1c5a7cfb826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:57.247151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db72a-b0b9-4bc5-a9f6-d1c5a7cfb826 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:57.247783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269db72a-b0b9-4bc5-a9f6-d1c5a7cfb826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:57.269580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269db72a-b0b9-4bc5-a9f6-d1c5a7cfb826 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:57.334543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 871/1736] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:28:56 2022] POST /identity/v3/users => generated 290 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:28:57.338683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f1aac-d299-4de5-bc7c-385b55f037c4 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:57.357499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f1aac-d299-4de5-bc7c-385b55f037c4 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:57.372375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab16790-a888-4c18-a291-59d65ef9d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:57.374776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab16790-a888-4c18-a291-59d65ef9d7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:57.375695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab16790-a888-4c18-a291-59d65ef9d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:57.376349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab16790-a888-4c18-a291-59d65ef9d7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:57.377222 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab16790-a888-4c18-a291-59d65ef9d7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:57.380481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab16790-a888-4c18-a291-59d65ef9d7c3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:57.412380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 866/1737] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:57.419250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269db72a-b0b9-4bc5-a9f6-d1c5a7cfb826 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:57.437705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269db72a-b0b9-4bc5-a9f6-d1c5a7cfb826 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:57.445233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737cf75-c6cf-423b-8d75-5e771ef32a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:57.446365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737cf75-c6cf-423b-8d75-5e771ef32a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:57.447335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737cf75-c6cf-423b-8d75-5e771ef32a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:57.448195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737cf75-c6cf-423b-8d75-5e771ef32a30 admin admin] PATH_INFO: `/v3/projects/f326e1c5a85c44b5ad287b490437b095/users/f9ec9e51e5d44251a941cfdc47ef95ef/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:57.494710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737cf75-c6cf-423b-8d75-5e771ef32a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f326e1c5a85c44b5ad287b490437b095, user_id=f9ec9e51e5d44251a941cfdc47ef95ef, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:57.498129 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737cf75-c6cf-423b-8d75-5e771ef32a30 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:57.531008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 872/1738] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:57 2022] PUT /identity/v3/projects/f326e1c5a85c44b5ad287b490437b095/users/f9ec9e51e5d44251a941cfdc47ef95ef/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:57.532924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab16790-a888-4c18-a291-59d65ef9d7c3 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:57.572234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab16790-a888-4c18-a291-59d65ef9d7c3 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:57.904855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387495d0-25f6-4dfc-96fe-55ff518ed585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:57.905570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387495d0-25f6-4dfc-96fe-55ff518ed585 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:57.905859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387495d0-25f6-4dfc-96fe-55ff518ed585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:57.911447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387495d0-25f6-4dfc-96fe-55ff518ed585 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:57.913516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387495d0-25f6-4dfc-96fe-55ff518ed585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:57.916384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387495d0-25f6-4dfc-96fe-55ff518ed585 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:57.937814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:28:57.945859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 867/1739] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:28:57.952792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737cf75-c6cf-423b-8d75-5e771ef32a30 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:57.977541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737cf75-c6cf-423b-8d75-5e771ef32a30 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:58.002383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:58.005326 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:58.007889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:58.008595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] PATH_INFO: `/v3/projects/f326e1c5a85c44b5ad287b490437b095/users/f9ec9e51e5d44251a941cfdc47ef95ef/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:58.013225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f326e1c5a85c44b5ad287b490437b095, user_id=f9ec9e51e5d44251a941cfdc47ef95ef, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:58.026713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:58.057517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 873/1740] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:28:57 2022] PUT /identity/v3/projects/f326e1c5a85c44b5ad287b490437b095/users/f9ec9e51e5d44251a941cfdc47ef95ef/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:28:58.062315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8f37f-7fbb-45aa-adf2-9cf6f9713826 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:58.062745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8f37f-7fbb-45aa-adf2-9cf6f9713826 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:58.063126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8f37f-7fbb-45aa-adf2-9cf6f9713826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:58.192418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-05f8f37f-7fbb-45aa-adf2-9cf6f9713826 None None] MFA Rules not processed for user `f9ec9e51e5d44251a941cfdc47ef95ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:58.199088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-05f8f37f-7fbb-45aa-adf2-9cf6f9713826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:58.441919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 868/1741] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:28:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:58.454647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:58.462465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:58.621657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b877-359d-4497-bd0a-0ae849692fa8 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:58.635929 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:58.636568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:58.636850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:58.637126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:58.657863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:58.661310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:58.714503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 874/1742] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:58.832326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433a61-1a58-4906-bb22-dea793945b7f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:58.833838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433a61-1a58-4906-bb22-dea793945b7f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:58.834424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433a61-1a58-4906-bb22-dea793945b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:58.910963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-24433a61-1a58-4906-bb22-dea793945b7f None None] MFA Rules not processed for user `17a501a048ed4b6c8186bfd490ad1394`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:28:58.914948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-24433a61-1a58-4906-bb22-dea793945b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:59.213146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 869/1743] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Aug 8 00:28:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:28:59.519897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:59.521341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:59.567124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433a61-1a58-4906-bb22-dea793945b7f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:28:59.568579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-24433a61-1a58-4906-bb22-dea793945b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:28:59.578662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dfec7-7cad-4d87-b2c3-d2c375620978 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:59.613403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8588-38b1-4af1-95e7-98f2e8eb87ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:59.614569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8588-38b1-4af1-95e7-98f2e8eb87ac service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:59.614855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8588-38b1-4af1-95e7-98f2e8eb87ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:59.615142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8588-38b1-4af1-95e7-98f2e8eb87ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:59.671501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc8588-38b1-4af1-95e7-98f2e8eb87ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:59.673009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc8588-38b1-4af1-95e7-98f2e8eb87ac service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:28:59.713058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 875/1744] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:28:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:28:59.837037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433a61-1a58-4906-bb22-dea793945b7f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:28:59.860536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:28:59.862832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:28:59.865293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:28:59.868456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] PATH_INFO: `/v3/projects/e77d53ee32f74dc587daaca60af07dc1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:28:59.875669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77d53ee32f74dc587daaca60af07dc1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:28:59.888938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:00.041043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:00.082937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77d53ee32f74dc587daaca60af07dc1', 'request_id': 'req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:00.112045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77d53ee32f74dc587daaca60af07dc1', 'request_id': 'req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:00.140118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77d53ee32f74dc587daaca60af07dc1', 'request_id': 'req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:00.211358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] The token cache is being invalidate because project e77d53ee32f74dc587daaca60af07dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:00.211663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:00.217752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-59d5b3fd-f0c9-4f64-b509-37a2896f9a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:00.221909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 870/1745] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:28:59 2022] DELETE /identity/v3/projects/e77d53ee32f74dc587daaca60af07dc1 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:00.229723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abeed5-563f-4b26-b427-cbe87d28efe5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:00.230301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abeed5-563f-4b26-b427-cbe87d28efe5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:00.230735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abeed5-563f-4b26-b427-cbe87d28efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:00.297928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-10abeed5-563f-4b26-b427-cbe87d28efe5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:00.299222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-10abeed5-563f-4b26-b427-cbe87d28efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:00.428247 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:00.620927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 876/1746] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:00.627896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e1985-e939-4ba3-8183-7c895ba109a4 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:00.628180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e1985-e939-4ba3-8183-7c895ba109a4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:00.628456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e1985-e939-4ba3-8183-7c895ba109a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:00.698920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8c2e1985-e939-4ba3-8183-7c895ba109a4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:00.700374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8c2e1985-e939-4ba3-8183-7c895ba109a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:00.731862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 871/1747] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:00.735962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abeed5-563f-4b26-b427-cbe87d28efe5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:00.756061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abeed5-563f-4b26-b427-cbe87d28efe5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:00.781241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:00.782805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:00.783095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:00.783377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:00.784054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:00.784359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:00.786784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:00.831953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 877/1748] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:00.837833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e1985-e939-4ba3-8183-7c895ba109a4 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:00.858781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e1985-e939-4ba3-8183-7c895ba109a4 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:00.879657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454660f-ec23-48f9-8d17-12a677a756cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:00.880288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454660f-ec23-48f9-8d17-12a677a756cb admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:00.880568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454660f-ec23-48f9-8d17-12a677a756cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:00.880840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454660f-ec23-48f9-8d17-12a677a756cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:00.881480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454660f-ec23-48f9-8d17-12a677a756cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:00.884252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454660f-ec23-48f9-8d17-12a677a756cb admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:00.998156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 872/1749] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:00 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:01.002055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:01.024654 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b4cbb-19d5-41c1-aff6-7c5bba5b895b admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:01.296367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba0d0-d163-428d-aada-41a97efad1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:01.297008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba0d0-d163-428d-aada-41a97efad1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:01.297295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba0d0-d163-428d-aada-41a97efad1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:01.297576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba0d0-d163-428d-aada-41a97efad1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:01.298265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceba0d0-d163-428d-aada-41a97efad1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:01.300194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceba0d0-d163-428d-aada-41a97efad1d2 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:01.382972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 878/1750] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:01 2022] POST /identity/v3/users => generated 286 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:01.387262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454660f-ec23-48f9-8d17-12a677a756cb admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:01.400959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454660f-ec23-48f9-8d17-12a677a756cb admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:01.418346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae323c-4f16-450c-a5c9-4490ae3793e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:01.420015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae323c-4f16-450c-a5c9-4490ae3793e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:01.420301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae323c-4f16-450c-a5c9-4490ae3793e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:01.420579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae323c-4f16-450c-a5c9-4490ae3793e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:01.421230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae323c-4f16-450c-a5c9-4490ae3793e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:01.431288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae323c-4f16-450c-a5c9-4490ae3793e9 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:01.464521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 873/1751] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:01.469153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba0d0-d163-428d-aada-41a97efad1d2 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:01.490131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba0d0-d163-428d-aada-41a97efad1d2 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:01.510789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee509f-6857-4a5d-92ac-8cae824ebb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:01.511741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee509f-6857-4a5d-92ac-8cae824ebb37 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:01.512214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee509f-6857-4a5d-92ac-8cae824ebb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:01.512685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee509f-6857-4a5d-92ac-8cae824ebb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:01.513517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee509f-6857-4a5d-92ac-8cae824ebb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:01.515402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee509f-6857-4a5d-92ac-8cae824ebb37 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:01.574414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 879/1752] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:01.577545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae323c-4f16-450c-a5c9-4490ae3793e9 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:01.601824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae323c-4f16-450c-a5c9-4490ae3793e9 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:01.628073 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:01.629102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:01.629707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:01.630196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] PATH_INFO: `/v3/projects/8896c82ba91a4455a5f73dc80a1ff6f8/users/8cbc05dcdd7045de8bceeefee61b2857/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:01.671072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8896c82ba91a4455a5f73dc80a1ff6f8, user_id=8cbc05dcdd7045de8bceeefee61b2857, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:01.674029 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:01.707404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 874/1753] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:01 2022] PUT /identity/v3/projects/8896c82ba91a4455a5f73dc80a1ff6f8/users/8cbc05dcdd7045de8bceeefee61b2857/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:01.712715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007bcc-9e85-4d60-9cd9-590d62dfcb6b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:01.713637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007bcc-9e85-4d60-9cd9-590d62dfcb6b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:01.714165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007bcc-9e85-4d60-9cd9-590d62dfcb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:01.759194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-db007bcc-9e85-4d60-9cd9-590d62dfcb6b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:01.760930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-db007bcc-9e85-4d60-9cd9-590d62dfcb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:02.020692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 880/1754] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:02.090664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:02.093269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:02.315098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaceed8-3b1e-40f0-9449-f1c4b794d9b8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:02.326761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2289e-a77c-4cf0-abbe-6ae9e0e3dc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:02.327723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2289e-a77c-4cf0-abbe-6ae9e0e3dc0a service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:02.328290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2289e-a77c-4cf0-abbe-6ae9e0e3dc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:02.328771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2289e-a77c-4cf0-abbe-6ae9e0e3dc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:02.367330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2289e-a77c-4cf0-abbe-6ae9e0e3dc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:02.377648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2289e-a77c-4cf0-abbe-6ae9e0e3dc0a service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:02.414472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 875/1755] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:03.597086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db007bcc-9e85-4d60-9cd9-590d62dfcb6b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:03.598747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-db007bcc-9e85-4d60-9cd9-590d62dfcb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:03.616463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db007bcc-9e85-4d60-9cd9-590d62dfcb6b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:03.630510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:03.631167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:03.631452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:03.631742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] PATH_INFO: `/v3/users/99e6acf77760480bae3dcf268bacc7c6` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:03.638650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e6acf77760480bae3dcf268bacc7c6)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:03.640623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:03.766293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:03.796051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e6acf77760480bae3dcf268bacc7c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:03.814200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e6acf77760480bae3dcf268bacc7c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:03.815229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e6acf77760480bae3dcf268bacc7c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:03.817668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e6acf77760480bae3dcf268bacc7c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:03.878322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e6acf77760480bae3dcf268bacc7c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:03.924285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 881/1756] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:03 2022] DELETE /identity/v3/users/99e6acf77760480bae3dcf268bacc7c6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:03.925160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450bc3-d35a-4fea-a912-a7b1c2a31bf8 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:03.925710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450bc3-d35a-4fea-a912-a7b1c2a31bf8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:03.926419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450bc3-d35a-4fea-a912-a7b1c2a31bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:03.997377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3d450bc3-d35a-4fea-a912-a7b1c2a31bf8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:04.008888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3d450bc3-d35a-4fea-a912-a7b1c2a31bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:04.289289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 876/1757] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:04.607898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:04.610462 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:04.813077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692563cd-be26-4bce-b41d-edbcacd9f473 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:04.823121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37f6e-68b9-4bb8-a429-e1efae4585f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:04.831301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37f6e-68b9-4bb8-a429-e1efae4585f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:04.831301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37f6e-68b9-4bb8-a429-e1efae4585f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:04.831301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37f6e-68b9-4bb8-a429-e1efae4585f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:04.867233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37f6e-68b9-4bb8-a429-e1efae4585f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:04.877440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37f6e-68b9-4bb8-a429-e1efae4585f2 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:04.903059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 882/1758] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:05.056573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d450bc3-d35a-4fea-a912-a7b1c2a31bf8 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:05.058097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3d450bc3-d35a-4fea-a912-a7b1c2a31bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:05.075173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:05.082935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d450bc3-d35a-4fea-a912-a7b1c2a31bf8 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:05.097390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:05.098195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:05.098523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:05.100789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] PATH_INFO: `/v3/users/0cf45dd584254163a1781ae0fe56a174` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:05.108063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf45dd584254163a1781ae0fe56a174)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:05.114873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:05.295593 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf45dd584254163a1781ae0fe56a174'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:05.308365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf45dd584254163a1781ae0fe56a174'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:05.310259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf45dd584254163a1781ae0fe56a174'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:05.338462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf45dd584254163a1781ae0fe56a174'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:05.367287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf45dd584254163a1781ae0fe56a174'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:05.376219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 877/1759] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:05 2022] DELETE /identity/v3/users/0cf45dd584254163a1781ae0fe56a174 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:05.381489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc27db-b720-44e1-b003-4b28f8090bc3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:05.381968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc27db-b720-44e1-b003-4b28f8090bc3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:05.382534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc27db-b720-44e1-b003-4b28f8090bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:05.411683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-30cc27db-b720-44e1-b003-4b28f8090bc3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:05.413654 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-30cc27db-b720-44e1-b003-4b28f8090bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:05.601685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 883/1760] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:05.694302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:05.697092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:05.902215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b517b7-d041-4177-a392-5ccad5657fac admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:05.906205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b52d4e-e418-43a4-9069-ef443677ba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:05.906832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52d4e-e418-43a4-9069-ef443677ba5d service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:05.907115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52d4e-e418-43a4-9069-ef443677ba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:05.907392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52d4e-e418-43a4-9069-ef443677ba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:05.933138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b52d4e-e418-43a4-9069-ef443677ba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:05.934776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b52d4e-e418-43a4-9069-ef443677ba5d service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:05.953167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 878/1761] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:06.427681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38a4a-0357-49a5-827c-b5d21da820d6 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:06.428260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38a4a-0357-49a5-827c-b5d21da820d6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:06.428634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38a4a-0357-49a5-827c-b5d21da820d6 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:06.430594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 884/1762] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:29:06.686705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aef26-0054-4a44-ac88-23417ec7f271 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:06.687376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aef26-0054-4a44-ac88-23417ec7f271 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:06.687376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aef26-0054-4a44-ac88-23417ec7f271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:06.703464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c905f-e445-43d0-bac4-fe97c0c50e72 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:06.703464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c905f-e445-43d0-bac4-fe97c0c50e72 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:06.703810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c905f-e445-43d0-bac4-fe97c0c50e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:06.721079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-cd2aef26-0054-4a44-ac88-23417ec7f271 None None] MFA Rules not processed for user `8c1dd80884d842669997cdb306ce0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:06.723299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cd2aef26-0054-4a44-ac88-23417ec7f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:06.761077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-721c905f-e445-43d0-bac4-fe97c0c50e72 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:06.765342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-721c905f-e445-43d0-bac4-fe97c0c50e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:06.902767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 879/1763] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:06.958606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:07.043226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 885/1764] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:29:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:07.248508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8679-f737-4fcf-9fb6-cf3e841d5294 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:07.248915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8679-f737-4fcf-9fb6-cf3e841d5294 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:07.249268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8679-f737-4fcf-9fb6-cf3e841d5294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:07.292424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-963f8679-f737-4fcf-9fb6-cf3e841d5294 None None] MFA Rules not processed for user `8cbc05dcdd7045de8bceeefee61b2857`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:07.294909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-963f8679-f737-4fcf-9fb6-cf3e841d5294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:07.312116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:07.348135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c905f-e445-43d0-bac4-fe97c0c50e72 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:07.349579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-721c905f-e445-43d0-bac4-fe97c0c50e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:07.387011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c905f-e445-43d0-bac4-fe97c0c50e72 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:07.397912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:07.398596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:07.398878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:07.399152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:07.413710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:07.415818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:07.434011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 886/1765] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:29:07.527495 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 880/1766] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:07.532723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:07.539309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:07.603870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763ee5a-2ddb-4435-a625-2d77b6437560 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:07.622456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb3790-5910-4c47-848c-093d8abb2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:07.625116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3790-5910-4c47-848c-093d8abb2cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:07.625416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3790-5910-4c47-848c-093d8abb2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:07.625738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb3790-5910-4c47-848c-093d8abb2cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:07.628307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb3790-5910-4c47-848c-093d8abb2cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:07.634520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb3790-5910-4c47-848c-093d8abb2cf2 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:07.730126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 887/1767] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:07 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:07.737102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8679-f737-4fcf-9fb6-cf3e841d5294 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:07.771931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8679-f737-4fcf-9fb6-cf3e841d5294 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:07.944878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7664821-a8b3-4fd7-8049-5bcac7e3907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:07.945790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7664821-a8b3-4fd7-8049-5bcac7e3907f admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:07.946295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7664821-a8b3-4fd7-8049-5bcac7e3907f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:07.946717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7664821-a8b3-4fd7-8049-5bcac7e3907f admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:07.947494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7664821-a8b3-4fd7-8049-5bcac7e3907f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:07.950366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7664821-a8b3-4fd7-8049-5bcac7e3907f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:07.993462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 881/1768] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:07 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:07.997957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb3790-5910-4c47-848c-093d8abb2cf2 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:08.015117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb3790-5910-4c47-848c-093d8abb2cf2 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:08.030391 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2dc69-191b-49be-a83a-2930256b6d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:08.031282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2dc69-191b-49be-a83a-2930256b6d99 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:08.031928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2dc69-191b-49be-a83a-2930256b6d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:08.032353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2dc69-191b-49be-a83a-2930256b6d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:08.033167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2dc69-191b-49be-a83a-2930256b6d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:08.035000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2dc69-191b-49be-a83a-2930256b6d99 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:08.057190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 888/1769] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:08.061922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7664821-a8b3-4fd7-8049-5bcac7e3907f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:08.079714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7664821-a8b3-4fd7-8049-5bcac7e3907f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:08.088375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596c6a-75b1-444f-bc6c-5f14720aa67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:08.089372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596c6a-75b1-444f-bc6c-5f14720aa67a admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:08.089810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596c6a-75b1-444f-bc6c-5f14720aa67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:08.090259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596c6a-75b1-444f-bc6c-5f14720aa67a admin admin] PATH_INFO: `/v3/projects/c809426b13134dab997ecbbf872d12bf/users/f8ad645d95774112877d5a6a99ae133d/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:08.132446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5596c6a-75b1-444f-bc6c-5f14720aa67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c809426b13134dab997ecbbf872d12bf, user_id=f8ad645d95774112877d5a6a99ae133d, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:08.140367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5596c6a-75b1-444f-bc6c-5f14720aa67a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:08.192522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 882/1770] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:08 2022] PUT /identity/v3/projects/c809426b13134dab997ecbbf872d12bf/users/f8ad645d95774112877d5a6a99ae133d/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:08.193393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2dc69-191b-49be-a83a-2930256b6d99 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:08.208509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2dc69-191b-49be-a83a-2930256b6d99 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:08.340095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19948c90-f435-43bb-8ec0-acb812c16960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:08.340733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948c90-f435-43bb-8ec0-acb812c16960 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:08.341026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948c90-f435-43bb-8ec0-acb812c16960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:08.341296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948c90-f435-43bb-8ec0-acb812c16960 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:08.341950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19948c90-f435-43bb-8ec0-acb812c16960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:08.343636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19948c90-f435-43bb-8ec0-acb812c16960 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:08.364379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 889/1771] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:08.369821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596c6a-75b1-444f-bc6c-5f14720aa67a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:08.386579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596c6a-75b1-444f-bc6c-5f14720aa67a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:08.398301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:08.401026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:08.402703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:08.403953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] PATH_INFO: `/v3/projects/c809426b13134dab997ecbbf872d12bf/users/f8ad645d95774112877d5a6a99ae133d/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:08.411259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c809426b13134dab997ecbbf872d12bf, user_id=f8ad645d95774112877d5a6a99ae133d, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:08.416833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:08.467093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 883/1772] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:08 2022] PUT /identity/v3/projects/c809426b13134dab997ecbbf872d12bf/users/f8ad645d95774112877d5a6a99ae133d/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:08.629152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ab19-6cb4-4f3e-a8f7-9bc35009bdd1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:08.629671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ab19-6cb4-4f3e-a8f7-9bc35009bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:08.629943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ab19-6cb4-4f3e-a8f7-9bc35009bdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:08.668019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bfa1ab19-6cb4-4f3e-a8f7-9bc35009bdd1 None None] MFA Rules not processed for user `17cc8db0bbd24c4098931f2c53381751`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:08.669548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bfa1ab19-6cb4-4f3e-a8f7-9bc35009bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:08.802613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 890/1773] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:09.461929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:09.466479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:09.608685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a13b5-e493-4957-a305-d96326656c25 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:09.609192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a13b5-e493-4957-a305-d96326656c25 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:09.609610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a13b5-e493-4957-a305-d96326656c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:09.643553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-934a13b5-e493-4957-a305-d96326656c25 None None] MFA Rules not processed for user `3e3151bac78942a69fb3764d5ef3814c`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:09.646255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-934a13b5-e493-4957-a305-d96326656c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:09.694193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0f52f-4ddc-4b10-8265-a16c76e8bcf6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:09.706936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:09.707627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:09.707916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:09.708277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] PATH_INFO: `/v3/projects/714dd6c44b45488ba232f43bbb1b7e74` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:09.712310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=714dd6c44b45488ba232f43bbb1b7e74)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:09.717517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:09.720342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:09.743348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:09.769037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 891/1774] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:09.815675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714dd6c44b45488ba232f43bbb1b7e74', 'request_id': 'req-9b14686d-0e3d-4c8b-89cf-18d63801e27e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:09.828336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714dd6c44b45488ba232f43bbb1b7e74', 'request_id': 'req-9b14686d-0e3d-4c8b-89cf-18d63801e27e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:09.845508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714dd6c44b45488ba232f43bbb1b7e74', 'request_id': 'req-9b14686d-0e3d-4c8b-89cf-18d63801e27e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:09.876797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a13b5-e493-4957-a305-d96326656c25 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:09.878748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-934a13b5-e493-4957-a305-d96326656c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:09.918370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] The token cache is being invalidate because project 714dd6c44b45488ba232f43bbb1b7e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:09.918754 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:09.920503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a13b5-e493-4957-a305-d96326656c25 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:09.921825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:09.929860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 884/1775] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:09 2022] DELETE /identity/v3/projects/714dd6c44b45488ba232f43bbb1b7e74 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:09.930883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:09.935993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:10.009373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:10.010014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:10.010487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:10.010760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] PATH_INFO: `/v3/projects/bdbd1ecf7c5e44edb47c1ca45d474670` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:10.011929 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbd1ecf7c5e44edb47c1ca45d474670)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:10.014174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:10.021711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14686d-0e3d-4c8b-89cf-18d63801e27e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:10.027231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:10.028020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:10.028305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:10.028705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] PATH_INFO: `/v3/users/f9ec9e51e5d44251a941cfdc47ef95ef` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:10.031208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ec9e51e5d44251a941cfdc47ef95ef)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:10.033173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:10.097920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbd1ecf7c5e44edb47c1ca45d474670', 'request_id': 'req-b64742f3-1449-4e81-acaa-c4558a3bd4bd'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.107243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ec9e51e5d44251a941cfdc47ef95ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.109990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbd1ecf7c5e44edb47c1ca45d474670', 'request_id': 'req-b64742f3-1449-4e81-acaa-c4558a3bd4bd'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.120951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ec9e51e5d44251a941cfdc47ef95ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.122119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ec9e51e5d44251a941cfdc47ef95ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.133951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ec9e51e5d44251a941cfdc47ef95ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.137288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbd1ecf7c5e44edb47c1ca45d474670', 'request_id': 'req-b64742f3-1449-4e81-acaa-c4558a3bd4bd'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.154241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ec9e51e5d44251a941cfdc47ef95ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.162249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] The token cache is being invalidate because project bdbd1ecf7c5e44edb47c1ca45d474670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:10.162839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 885/1776] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:09 2022] DELETE /identity/v3/users/f9ec9e51e5d44251a941cfdc47ef95ef => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:10.165937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.166935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b64742f3-1449-4e81-acaa-c4558a3bd4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.169013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 892/1777] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:09 2022] DELETE /identity/v3/projects/bdbd1ecf7c5e44edb47c1ca45d474670 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:10.172673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:10.174645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:10.203341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:10.304596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba619a70-5276-4e8e-95dc-210fe78a0acb admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:10.310342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:10.311111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:10.311484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:10.311826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] PATH_INFO: `/v3/users/f8feec3002f04a649062313c7be8862b` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:10.313349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8feec3002f04a649062313c7be8862b)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:10.316327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:10.389614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8feec3002f04a649062313c7be8862b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.401768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8feec3002f04a649062313c7be8862b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.402568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8feec3002f04a649062313c7be8862b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.419271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8feec3002f04a649062313c7be8862b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.440638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-39ba0a39-25d4-4e18-a57c-3a34a349c747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8feec3002f04a649062313c7be8862b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:10.455472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 886/1778] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:10 2022] DELETE /identity/v3/users/f8feec3002f04a649062313c7be8862b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:10.457544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2d523-f852-4e5f-8569-b9dfd34f7d38 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:10.458098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2d523-f852-4e5f-8569-b9dfd34f7d38 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:10.458930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2d523-f852-4e5f-8569-b9dfd34f7d38 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:10.460997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 893/1779] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:29:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:29:10.495720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69594d-eabf-4f39-921f-f3a466689d87 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:10.496203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69594d-eabf-4f39-921f-f3a466689d87 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:10.496377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69594d-eabf-4f39-921f-f3a466689d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:10.547716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-1e69594d-eabf-4f39-921f-f3a466689d87 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:10.552058 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1e69594d-eabf-4f39-921f-f3a466689d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:10.742368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 887/1780] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:29:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:10.763781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d7d-c741-4c3e-8537-cd1aca9a6838 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:10.764291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d7d-c741-4c3e-8537-cd1aca9a6838 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:10.764371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d7d-c741-4c3e-8537-cd1aca9a6838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:10.887069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c3154d7d-c741-4c3e-8537-cd1aca9a6838 None None] MFA Rules not processed for user `f8ad645d95774112877d5a6a99ae133d`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:10.888730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c3154d7d-c741-4c3e-8537-cd1aca9a6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:11.048240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:11.084407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef05ec1-2c37-4d17-ab2f-55f47c712dab None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:11.084868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef05ec1-2c37-4d17-ab2f-55f47c712dab None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:11.085345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef05ec1-2c37-4d17-ab2f-55f47c712dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:11.088165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 894/1781] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:11.154717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-6ef05ec1-2c37-4d17-ab2f-55f47c712dab None None] MFA Rules not processed for user `8cbc05dcdd7045de8bceeefee61b2857`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:11.160344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6ef05ec1-2c37-4d17-ab2f-55f47c712dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:11.215534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:11.291656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 888/1782] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:11.535199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154d7d-c741-4c3e-8537-cd1aca9a6838 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:11.536735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c3154d7d-c741-4c3e-8537-cd1aca9a6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:11.636776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154d7d-c741-4c3e-8537-cd1aca9a6838 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:11.643108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:11.644805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:11.645191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:11.645558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] PATH_INFO: `/v3/projects/f326e1c5a85c44b5ad287b490437b095` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:11.647462 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f326e1c5a85c44b5ad287b490437b095)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:11.648963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:11.703455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f326e1c5a85c44b5ad287b490437b095', 'request_id': 'req-9eb359a5-2b65-42e5-af27-91d278251d37'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:11.711031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f326e1c5a85c44b5ad287b490437b095', 'request_id': 'req-9eb359a5-2b65-42e5-af27-91d278251d37'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:11.718475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f326e1c5a85c44b5ad287b490437b095', 'request_id': 'req-9eb359a5-2b65-42e5-af27-91d278251d37'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:11.733356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] The token cache is being invalidate because project f326e1c5a85c44b5ad287b490437b095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:11.733729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:11.735071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9eb359a5-2b65-42e5-af27-91d278251d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:11.736959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 895/1783] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:11 2022] DELETE /identity/v3/projects/f326e1c5a85c44b5ad287b490437b095 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:11.742110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bcf1-d3f0-413a-8c0b-c90f7d3f3498 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:11.742610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bcf1-d3f0-413a-8c0b-c90f7d3f3498 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:11.743198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bcf1-d3f0-413a-8c0b-c90f7d3f3498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:11.765540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a7d6bcf1-d3f0-413a-8c0b-c90f7d3f3498 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:11.766978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a7d6bcf1-d3f0-413a-8c0b-c90f7d3f3498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:11.837501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 889/1784] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:11.845752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232b60d-107c-43d2-ab54-874d3f759714 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:11.846791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232b60d-107c-43d2-ab54-874d3f759714 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:11.847077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232b60d-107c-43d2-ab54-874d3f759714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:11.897472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6bcf1-d3f0-413a-8c0b-c90f7d3f3498 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:11.898811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6232b60d-107c-43d2-ab54-874d3f759714 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:11.899561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a7d6bcf1-d3f0-413a-8c0b-c90f7d3f3498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:11.900499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6232b60d-107c-43d2-ab54-874d3f759714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:11.913346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6bcf1-d3f0-413a-8c0b-c90f7d3f3498 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:11.915502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 896/1785] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:11.916617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232b60d-107c-43d2-ab54-874d3f759714 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:11.918799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:11.919442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:11.919814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:11.920089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] PATH_INFO: `/v3/projects/092380cab4f340bc9c22f050dad16487` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:11.921265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092380cab4f340bc9c22f050dad16487)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:11.923205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:11.929541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232b60d-107c-43d2-ab54-874d3f759714 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:11.934521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:11.935239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:11.935740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:11.936427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:11.937280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:11.937782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:11.939815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:11.957029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 897/1786] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:11.961954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:11.977582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a6121-9865-4009-b377-69336c78d15b admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:11.999455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092380cab4f340bc9c22f050dad16487', 'request_id': 'req-03942f08-8d57-4bd1-a7ab-376bc79bfd62'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:12.008347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092380cab4f340bc9c22f050dad16487', 'request_id': 'req-03942f08-8d57-4bd1-a7ab-376bc79bfd62'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:12.026313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092380cab4f340bc9c22f050dad16487', 'request_id': 'req-03942f08-8d57-4bd1-a7ab-376bc79bfd62'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:12.046180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] The token cache is being invalidate because project 092380cab4f340bc9c22f050dad16487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:12.046459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:12.047163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03942f08-8d57-4bd1-a7ab-376bc79bfd62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:12.050156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 890/1787] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:11 2022] DELETE /identity/v3/projects/092380cab4f340bc9c22f050dad16487 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:12.054203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b06b-8e91-4262-9d8f-c6881af628ca None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.054520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b06b-8e91-4262-9d8f-c6881af628ca None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.054794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b06b-8e91-4262-9d8f-c6881af628ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.095265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.095968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.096431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.096948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.097878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-4b02b06b-8e91-4262-9d8f-c6881af628ca None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:12.098050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.099128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4b02b06b-8e91-4262-9d8f-c6881af628ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:12.101118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.112670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 891/1788] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:12.120095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:12.121629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2e66-a49b-4a1d-9713-246eff487666 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.122356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2e66-a49b-4a1d-9713-246eff487666 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.122356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2e66-a49b-4a1d-9713-246eff487666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.142318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 898/1789] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:11 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:12.147412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.149553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:12.154096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-4acd2e66-a49b-4a1d-9713-246eff487666 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:12.161615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4acd2e66-a49b-4a1d-9713-246eff487666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:12.228414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:12.258257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079ef7f-4696-4474-975c-f8e4f029f1c5 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.263435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebdcb4-44cd-4cb9-aae3-e1a6a22ee684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.264043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebdcb4-44cd-4cb9-aae3-e1a6a22ee684 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.264331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebdcb4-44cd-4cb9-aae3-e1a6a22ee684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.264605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebdcb4-44cd-4cb9-aae3-e1a6a22ee684 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.265229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebdcb4-44cd-4cb9-aae3-e1a6a22ee684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.267537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebdcb4-44cd-4cb9-aae3-e1a6a22ee684 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.275814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 892/1790] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:12.279696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2e66-a49b-4a1d-9713-246eff487666 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.294236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2e66-a49b-4a1d-9713-246eff487666 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.300900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.302025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.302417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.302683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 899/1791] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:12 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:12.302932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.303503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:12.303819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.305774 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.307238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebdcb4-44cd-4cb9-aae3-e1a6a22ee684 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.326725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebdcb4-44cd-4cb9-aae3-e1a6a22ee684 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.328137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 893/1792] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:12.333075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.339135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed7fbb-05af-4115-9852-46e0d5573b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.340359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7fbb-05af-4115-9852-46e0d5573b5b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.340748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7fbb-05af-4115-9852-46e0d5573b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.341182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7fbb-05af-4115-9852-46e0d5573b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.342098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed7fbb-05af-4115-9852-46e0d5573b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.344428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed7fbb-05af-4115-9852-46e0d5573b5b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.359356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 900/1793] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:12.360575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687f91-a84e-4c02-9c0f-b66bd6d5076b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.363824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed7fbb-05af-4115-9852-46e0d5573b5b admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.375596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5a1c-9d76-4d14-82ad-657bf1e62dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.376037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed7fbb-05af-4115-9852-46e0d5573b5b admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.376809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5a1c-9d76-4d14-82ad-657bf1e62dfd admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.377157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5a1c-9d76-4d14-82ad-657bf1e62dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.377484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5a1c-9d76-4d14-82ad-657bf1e62dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.378259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d5a1c-9d76-4d14-82ad-657bf1e62dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.384022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.384873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.385229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.385653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.386602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d5a1c-9d76-4d14-82ad-657bf1e62dfd admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.386696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.388691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.422799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 901/1794] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:12.423838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.426687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:12.474114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 894/1795] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:12 2022] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:12.474114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5a1c-9d76-4d14-82ad-657bf1e62dfd admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.537308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2ad6f-8998-4c50-8021-29f156831b5c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.595444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5a1c-9d76-4d14-82ad-657bf1e62dfd admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.604682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e985286-895b-4d21-a95e-39c2d19a83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.607168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985286-895b-4d21-a95e-39c2d19a83a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.607866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985286-895b-4d21-a95e-39c2d19a83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.608217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985286-895b-4d21-a95e-39c2d19a83a0 admin admin] PATH_INFO: `/v3/projects/33928c2444dd44f2bad45fb5f544da07/users/4f8ea8f502794c03a6914ff4bbd39a4f/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.631160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:12.643631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e985286-895b-4d21-a95e-39c2d19a83a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33928c2444dd44f2bad45fb5f544da07, user_id=4f8ea8f502794c03a6914ff4bbd39a4f, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.649291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e985286-895b-4d21-a95e-39c2d19a83a0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.653981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0cf8-823a-4b96-9872-3ac53f34f872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.655434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0cf8-823a-4b96-9872-3ac53f34f872 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.655943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0cf8-823a-4b96-9872-3ac53f34f872 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.656322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0cf8-823a-4b96-9872-3ac53f34f872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.658682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-000f0cf8-823a-4b96-9872-3ac53f34f872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:12.674474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0cf8-823a-4b96-9872-3ac53f34f872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.676805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0cf8-823a-4b96-9872-3ac53f34f872 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.682197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 895/1796] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:12 2022] PUT /identity/v3/projects/33928c2444dd44f2bad45fb5f544da07/users/4f8ea8f502794c03a6914ff4bbd39a4f/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:12.683269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e985286-895b-4d21-a95e-39c2d19a83a0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.688801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 902/1797] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:12.693726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d11c7-6b01-47f6-bc9d-a242788de375 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.694146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d11c7-6b01-47f6-bc9d-a242788de375 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.694553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d11c7-6b01-47f6-bc9d-a242788de375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.729681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-cc9d11c7-6b01-47f6-bc9d-a242788de375 None None] MFA Rules not processed for user `4f8ea8f502794c03a6914ff4bbd39a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:12.731234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cc9d11c7-6b01-47f6-bc9d-a242788de375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:12.812265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e985286-895b-4d21-a95e-39c2d19a83a0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.818198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e136ff-c82a-4296-88c0-d0f0b0e0cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.819093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e136ff-c82a-4296-88c0-d0f0b0e0cfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.819443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e136ff-c82a-4296-88c0-d0f0b0e0cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.819780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e136ff-c82a-4296-88c0-d0f0b0e0cfc1 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.820478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e136ff-c82a-4296-88c0-d0f0b0e0cfc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.822558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e136ff-c82a-4296-88c0-d0f0b0e0cfc1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.845191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 903/1798] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:12.846482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d11c7-6b01-47f6-bc9d-a242788de375 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.850157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cc9d11c7-6b01-47f6-bc9d-a242788de375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:12.855888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 896/1799] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:12 2022] POST /identity/v3/users => generated 305 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:12.856765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e136ff-c82a-4296-88c0-d0f0b0e0cfc1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.873767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e136ff-c82a-4296-88c0-d0f0b0e0cfc1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:12.881538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdced9-fa28-4122-b714-8eb83445ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:12.882368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdced9-fa28-4122-b714-8eb83445ca0c admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:12.882797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdced9-fa28-4122-b714-8eb83445ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:12.883352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdced9-fa28-4122-b714-8eb83445ca0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:12.884100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdced9-fa28-4122-b714-8eb83445ca0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:12.886952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdced9-fa28-4122-b714-8eb83445ca0c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:12.928115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 897/1800] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:12 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:12.932785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdced9-fa28-4122-b714-8eb83445ca0c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:12.943591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:12.994385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d11c7-6b01-47f6-bc9d-a242788de375 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.030284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdced9-fa28-4122-b714-8eb83445ca0c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.036634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e735b-d788-4f22-9670-b635c149e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.037393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e735b-d788-4f22-9670-b635c149e82c admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.037710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e735b-d788-4f22-9670-b635c149e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.038411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e735b-d788-4f22-9670-b635c149e82c admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.039337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e735b-d788-4f22-9670-b635c149e82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.042979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e735b-d788-4f22-9670-b635c149e82c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.055125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 898/1801] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:13.055936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e735b-d788-4f22-9670-b635c149e82c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.068006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e735b-d788-4f22-9670-b635c149e82c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.072592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc52092-774e-482b-9a29-fad14826938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.073162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc52092-774e-482b-9a29-fad14826938f admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.073441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc52092-774e-482b-9a29-fad14826938f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.073741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc52092-774e-482b-9a29-fad14826938f admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.074378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc52092-774e-482b-9a29-fad14826938f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.076270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc52092-774e-482b-9a29-fad14826938f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.076627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.077237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.077520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.077793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.079560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:13.090343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:13.098799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 899/1802] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:13 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:13.099625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc52092-774e-482b-9a29-fad14826938f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.109834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc52092-774e-482b-9a29-fad14826938f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.115345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3499e63-0dd4-41ea-95af-a1d3a991a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.116443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3499e63-0dd4-41ea-95af-a1d3a991a2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.116443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3499e63-0dd4-41ea-95af-a1d3a991a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.116642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3499e63-0dd4-41ea-95af-a1d3a991a2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.117244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3499e63-0dd4-41ea-95af-a1d3a991a2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.119020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3499e63-0dd4-41ea-95af-a1d3a991a2c1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.129594 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 900/1803] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:13.130512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3499e63-0dd4-41ea-95af-a1d3a991a2c1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.139615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3499e63-0dd4-41ea-95af-a1d3a991a2c1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.145059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf217f-4efe-4cdd-9556-d65ad2625abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.145624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf217f-4efe-4cdd-9556-d65ad2625abf admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.145908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf217f-4efe-4cdd-9556-d65ad2625abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.146232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf217f-4efe-4cdd-9556-d65ad2625abf admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.146322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.146844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf217f-4efe-4cdd-9556-d65ad2625abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.147848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.148396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf217f-4efe-4cdd-9556-d65ad2625abf admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.156661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 904/1804] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:13.157431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.158169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 901/1805] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:13.162837 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf217f-4efe-4cdd-9556-d65ad2625abf admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.167707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06bf6-c7c2-484c-b7e4-0f42485dcb55 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.172424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28541b-bd40-4087-b188-0e5ae6027fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.172559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf217f-4efe-4cdd-9556-d65ad2625abf admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.173136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28541b-bd40-4087-b188-0e5ae6027fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.173360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28541b-bd40-4087-b188-0e5ae6027fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.173820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28541b-bd40-4087-b188-0e5ae6027fdc admin admin] PATH_INFO: `/v3/projects/e09a681e732d4c5ebb9322ee7ed921f4/users/5f7c83d18c6a47caa8b26dc5c1604dfc/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.178048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4efb21-427e-4ead-a9fe-05e86220ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.178718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4efb21-427e-4ead-a9fe-05e86220ec4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.179003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4efb21-427e-4ead-a9fe-05e86220ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.179280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4efb21-427e-4ead-a9fe-05e86220ec4c admin admin] PATH_INFO: `/v3/projects/5f9e5f201b6b4b0d96cafcb3a35531ec/users/112d1133f16840c2be295c4d573dd911/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.188753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28541b-bd40-4087-b188-0e5ae6027fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09a681e732d4c5ebb9322ee7ed921f4, user_id=5f7c83d18c6a47caa8b26dc5c1604dfc, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.191467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28541b-bd40-4087-b188-0e5ae6027fdc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.201303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4efb21-427e-4ead-a9fe-05e86220ec4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9e5f201b6b4b0d96cafcb3a35531ec, user_id=112d1133f16840c2be295c4d573dd911, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.204177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4efb21-427e-4ead-a9fe-05e86220ec4c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.207901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 905/1806] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:13 2022] PUT /identity/v3/projects/e09a681e732d4c5ebb9322ee7ed921f4/users/5f7c83d18c6a47caa8b26dc5c1604dfc/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:13.219316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab332-97ce-438d-af22-c138d66ff9e1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.219607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab332-97ce-438d-af22-c138d66ff9e1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.219879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab332-97ce-438d-af22-c138d66ff9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.224991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 902/1807] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:13 2022] PUT /identity/v3/projects/5f9e5f201b6b4b0d96cafcb3a35531ec/users/112d1133f16840c2be295c4d573dd911/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:13.231334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4efb21-427e-4ead-a9fe-05e86220ec4c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.255661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b47ab332-97ce-438d-af22-c138d66ff9e1 None None] MFA Rules not processed for user `5f7c83d18c6a47caa8b26dc5c1604dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:13.257157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b47ab332-97ce-438d-af22-c138d66ff9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:13.302314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4efb21-427e-4ead-a9fe-05e86220ec4c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.308427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414687-6cb5-4e2b-9f45-7ce84b8ee5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.308771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414687-6cb5-4e2b-9f45-7ce84b8ee5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.309057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414687-6cb5-4e2b-9f45-7ce84b8ee5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.309334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414687-6cb5-4e2b-9f45-7ce84b8ee5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.309990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5414687-6cb5-4e2b-9f45-7ce84b8ee5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.311636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5414687-6cb5-4e2b-9f45-7ce84b8ee5b4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.322428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 903/1808] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:13.326908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414687-6cb5-4e2b-9f45-7ce84b8ee5b4 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.337799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414687-6cb5-4e2b-9f45-7ce84b8ee5b4 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.342509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e45d0-c875-4c31-9b91-69f1c1598275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.346005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 906/1809] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:13 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:13.346169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e45d0-c875-4c31-9b91-69f1c1598275 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.346169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e45d0-c875-4c31-9b91-69f1c1598275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.346169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e45d0-c875-4c31-9b91-69f1c1598275 admin admin] PATH_INFO: `/v3/projects/5f9e5f201b6b4b0d96cafcb3a35531ec/users/112d1133f16840c2be295c4d573dd911/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.347988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ab332-97ce-438d-af22-c138d66ff9e1 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.348112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e45d0-c875-4c31-9b91-69f1c1598275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9e5f201b6b4b0d96cafcb3a35531ec, user_id=112d1133f16840c2be295c4d573dd911, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.350723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e45d0-c875-4c31-9b91-69f1c1598275 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.358884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ab332-97ce-438d-af22-c138d66ff9e1 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.364632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 904/1810] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:13 2022] PUT /identity/v3/projects/5f9e5f201b6b4b0d96cafcb3a35531ec/users/112d1133f16840c2be295c4d573dd911/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:13.375928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b4644-d413-408d-8305-230ed66ae264 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.376140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b4644-d413-408d-8305-230ed66ae264 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.376418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b4644-d413-408d-8305-230ed66ae264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.408187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-109b4644-d413-408d-8305-230ed66ae264 None None] MFA Rules not processed for user `112d1133f16840c2be295c4d573dd911`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:13.409756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-109b4644-d413-408d-8305-230ed66ae264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:13.421731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:13.425163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b251-a9c0-41ff-9328-7336ace3866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.425976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b251-a9c0-41ff-9328-7336ace3866d admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.426390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b251-a9c0-41ff-9328-7336ace3866d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.426740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b251-a9c0-41ff-9328-7336ace3866d admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.427527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b251-a9c0-41ff-9328-7336ace3866d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.430388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b251-a9c0-41ff-9328-7336ace3866d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.465812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 907/1811] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:13 2022] POST /identity/v3/projects => generated 407 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:13.469793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b251-a9c0-41ff-9328-7336ace3866d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.485390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:13.515929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 905/1812] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:13.529765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b4644-d413-408d-8305-230ed66ae264 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.531245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-109b4644-d413-408d-8305-230ed66ae264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:13.597580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b251-a9c0-41ff-9328-7336ace3866d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.613579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3e623-46e1-4a9b-b26a-5becb4aeae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.614646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3e623-46e1-4a9b-b26a-5becb4aeae98 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.614941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3e623-46e1-4a9b-b26a-5becb4aeae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.615305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3e623-46e1-4a9b-b26a-5becb4aeae98 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.615881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3e623-46e1-4a9b-b26a-5becb4aeae98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.618096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3e623-46e1-4a9b-b26a-5becb4aeae98 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.625467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b4644-d413-408d-8305-230ed66ae264 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.650982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 908/1813] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:13 2022] POST /identity/v3/users => generated 310 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:13.656505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3e623-46e1-4a9b-b26a-5becb4aeae98 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.670041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3e623-46e1-4a9b-b26a-5becb4aeae98 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.676670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582f6b-171d-4849-b4eb-381cfb355e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.677299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582f6b-171d-4849-b4eb-381cfb355e61 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.677584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582f6b-171d-4849-b4eb-381cfb355e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.677881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582f6b-171d-4849-b4eb-381cfb355e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.679197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582f6b-171d-4849-b4eb-381cfb355e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.680790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582f6b-171d-4849-b4eb-381cfb355e61 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.695765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 909/1814] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:13.700363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582f6b-171d-4849-b4eb-381cfb355e61 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.711319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9058fe-103b-4a3a-97be-991031d4ac5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.711990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9058fe-103b-4a3a-97be-991031d4ac5f service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.712263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9058fe-103b-4a3a-97be-991031d4ac5f service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.712551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9058fe-103b-4a3a-97be-991031d4ac5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.714356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582f6b-171d-4849-b4eb-381cfb355e61 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.720943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f8a9a-04b2-4eb2-99cb-f1089243f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.721764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f8a9a-04b2-4eb2-99cb-f1089243f9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.722330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f8a9a-04b2-4eb2-99cb-f1089243f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.722682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f8a9a-04b2-4eb2-99cb-f1089243f9a1 admin admin] PATH_INFO: `/v3/projects/00a7029d66134168b74c543c7018a3f4/users/3e21d0e1796645799ef6de3a86ffc12a/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.742782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f8a9a-04b2-4eb2-99cb-f1089243f9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a7029d66134168b74c543c7018a3f4, user_id=3e21d0e1796645799ef6de3a86ffc12a, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.746962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f8a9a-04b2-4eb2-99cb-f1089243f9a1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.770281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 910/1815] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:13 2022] PUT /identity/v3/projects/00a7029d66134168b74c543c7018a3f4/users/3e21d0e1796645799ef6de3a86ffc12a/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:13.773687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f8a9a-04b2-4eb2-99cb-f1089243f9a1 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.800861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9058fe-103b-4a3a-97be-991031d4ac5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.802509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9058fe-103b-4a3a-97be-991031d4ac5f service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.815766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 906/1816] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:29:13.877802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f8a9a-04b2-4eb2-99cb-f1089243f9a1 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.884130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ee831-0420-4a00-a223-e1fe313feae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.884747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee831-0420-4a00-a223-e1fe313feae7 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.885031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee831-0420-4a00-a223-e1fe313feae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.885309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee831-0420-4a00-a223-e1fe313feae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.885960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ee831-0420-4a00-a223-e1fe313feae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.888472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ee831-0420-4a00-a223-e1fe313feae7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:13.903940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 911/1817] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:13.906961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9058fe-103b-4a3a-97be-991031d4ac5f service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:13.929572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9058fe-103b-4a3a-97be-991031d4ac5f service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:13.947744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b52b74-9172-4737-8141-8387e3b08afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:13.948614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52b74-9172-4737-8141-8387e3b08afe admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:13.949000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52b74-9172-4737-8141-8387e3b08afe admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:13.949275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52b74-9172-4737-8141-8387e3b08afe admin admin] PATH_INFO: `/v3/projects/00a7029d66134168b74c543c7018a3f4/users/3e21d0e1796645799ef6de3a86ffc12a/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:13.957183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b52b74-9172-4737-8141-8387e3b08afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a7029d66134168b74c543c7018a3f4, user_id=3e21d0e1796645799ef6de3a86ffc12a, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:13.969409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b52b74-9172-4737-8141-8387e3b08afe admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:14.010718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 907/1818] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:13 2022] PUT /identity/v3/projects/00a7029d66134168b74c543c7018a3f4/users/3e21d0e1796645799ef6de3a86ffc12a/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:14.012500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca9a0-97ca-4cb5-9e67-75377b1ece49 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:14.014637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca9a0-97ca-4cb5-9e67-75377b1ece49 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:14.014921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca9a0-97ca-4cb5-9e67-75377b1ece49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:14.141087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-758ca9a0-97ca-4cb5-9e67-75377b1ece49 None None] MFA Rules not processed for user `3e21d0e1796645799ef6de3a86ffc12a`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:14.143623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-758ca9a0-97ca-4cb5-9e67-75377b1ece49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:14.288921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:14.383650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 912/1819] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:14 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:14.397073 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b52b74-9172-4737-8141-8387e3b08afe admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:14.403752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:14.606434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b52b74-9172-4737-8141-8387e3b08afe admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:14.612325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:14.613899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:14.615121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:14.615547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:14.643536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:14.648212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:14.687678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 908/1820] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:14 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:14.994227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca9a0-97ca-4cb5-9e67-75377b1ece49 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:15.005197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca9a0-97ca-4cb5-9e67-75377b1ece49 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:15.008839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d23a58-08b6-4cc8-a832-4ac0314f5451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:15.009522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23a58-08b6-4cc8-a832-4ac0314f5451 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:15.009874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23a58-08b6-4cc8-a832-4ac0314f5451 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:15.010245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23a58-08b6-4cc8-a832-4ac0314f5451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:15.072320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d23a58-08b6-4cc8-a832-4ac0314f5451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:15.073875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d23a58-08b6-4cc8-a832-4ac0314f5451 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:15.084656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 913/1821] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:14 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:29:16.780922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:16.782352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:16.793892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661c1c-0421-4a65-a8af-69b42e85a078 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:16.797846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c8c41-3076-452b-a150-724960d919ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:16.798546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8c41-3076-452b-a150-724960d919ca service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:16.798830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8c41-3076-452b-a150-724960d919ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:16.799392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8c41-3076-452b-a150-724960d919ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:16.859884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c8c41-3076-452b-a150-724960d919ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:16.861340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c8c41-3076-452b-a150-724960d919ca service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:16.871668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 909/1822] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:18.385587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba3b1-f2e3-42ad-87ab-2612d27170d4 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:18.386118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba3b1-f2e3-42ad-87ab-2612d27170d4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:18.386309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba3b1-f2e3-42ad-87ab-2612d27170d4 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:18.387770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 914/1823] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:29:18.401567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61993e5d-d626-48b6-8437-e0c7831d8228 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:18.402154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61993e5d-d626-48b6-8437-e0c7831d8228 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:18.402389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61993e5d-d626-48b6-8437-e0c7831d8228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:18.449650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-61993e5d-d626-48b6-8437-e0c7831d8228 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:18.451155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-61993e5d-d626-48b6-8437-e0c7831d8228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:18.531680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 910/1824] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:29:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:18.545693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edba3b1-f2e3-42ad-87ab-2612d27170d4 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:18.565500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edba3b1-f2e3-42ad-87ab-2612d27170d4 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:18.570956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35cacd-e9e4-4017-a902-332939dbd97a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:18.571554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35cacd-e9e4-4017-a902-332939dbd97a service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:18.571842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35cacd-e9e4-4017-a902-332939dbd97a service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:18.572120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35cacd-e9e4-4017-a902-332939dbd97a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:18.580774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35cacd-e9e4-4017-a902-332939dbd97a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:18.582906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35cacd-e9e4-4017-a902-332939dbd97a service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:18.593137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 915/1825] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:20.654218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61993e5d-d626-48b6-8437-e0c7831d8228 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:20.731921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:20.826637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61993e5d-d626-48b6-8437-e0c7831d8228 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:20.840220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:20.841648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:20.842146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:20.842435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] PATH_INFO: `/v3/users/5f7c83d18c6a47caa8b26dc5c1604dfc` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:20.843787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7c83d18c6a47caa8b26dc5c1604dfc)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:20.847481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:20.971042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7c83d18c6a47caa8b26dc5c1604dfc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:20.982573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7c83d18c6a47caa8b26dc5c1604dfc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:20.983383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7c83d18c6a47caa8b26dc5c1604dfc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:20.996400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7c83d18c6a47caa8b26dc5c1604dfc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:21.015718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7c83d18c6a47caa8b26dc5c1604dfc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:21.031669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 911/1826] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:20 2022] DELETE /identity/v3/users/5f7c83d18c6a47caa8b26dc5c1604dfc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:21.036305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538b65-7871-4b2b-901f-6a0de001fd1e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:21.037101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538b65-7871-4b2b-901f-6a0de001fd1e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:21.037530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538b65-7871-4b2b-901f-6a0de001fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:21.066994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d8538b65-7871-4b2b-901f-6a0de001fd1e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:21.069512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d8538b65-7871-4b2b-901f-6a0de001fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:21.159957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 916/1827] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:21.195768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:21.197744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:21.279685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb81c9-2213-4db4-95d0-a9d07d384b53 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:21.286297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabcb95-f9d3-4252-9f14-0a4cb9dd06ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:21.286936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabcb95-f9d3-4252-9f14-0a4cb9dd06ae service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:21.287221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabcb95-f9d3-4252-9f14-0a4cb9dd06ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:21.287496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabcb95-f9d3-4252-9f14-0a4cb9dd06ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:21.299940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabcb95-f9d3-4252-9f14-0a4cb9dd06ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:21.302387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabcb95-f9d3-4252-9f14-0a4cb9dd06ae service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:21.316108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 912/1828] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:22.635298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538b65-7871-4b2b-901f-6a0de001fd1e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:22.637381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d8538b65-7871-4b2b-901f-6a0de001fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:22.672873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538b65-7871-4b2b-901f-6a0de001fd1e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:22.685026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:22.685931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:22.686594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:22.687017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] PATH_INFO: `/v3/projects/e09a681e732d4c5ebb9322ee7ed921f4` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:22.688526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09a681e732d4c5ebb9322ee7ed921f4)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:22.712492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:22.810571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09a681e732d4c5ebb9322ee7ed921f4', 'request_id': 'req-a55bb0a8-bc52-4273-a0be-da57f59326fb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:22.823268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09a681e732d4c5ebb9322ee7ed921f4', 'request_id': 'req-a55bb0a8-bc52-4273-a0be-da57f59326fb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:22.828706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:22.840268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09a681e732d4c5ebb9322ee7ed921f4', 'request_id': 'req-a55bb0a8-bc52-4273-a0be-da57f59326fb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:22.872073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] The token cache is being invalidate because project e09a681e732d4c5ebb9322ee7ed921f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:22.872990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:22.874120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:22.876926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 917/1829] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:22 2022] DELETE /identity/v3/projects/e09a681e732d4c5ebb9322ee7ed921f4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:22.881356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabcb95-f9d3-4252-9f14-0a4cb9dd06ae service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:22.915233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabcb95-f9d3-4252-9f14-0a4cb9dd06ae service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:23.033469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:23.062849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:23.063629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:23.063977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:23.064618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] PATH_INFO: `/v3/users/3e21d0e1796645799ef6de3a86ffc12a` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:23.068921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e21d0e1796645799ef6de3a86ffc12a)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:23.070720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:23.133033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e21d0e1796645799ef6de3a86ffc12a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:23.172209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e21d0e1796645799ef6de3a86ffc12a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:23.172851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e21d0e1796645799ef6de3a86ffc12a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:23.190103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e21d0e1796645799ef6de3a86ffc12a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:23.237716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-795d8732-ac8e-457c-b355-c824482da5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e21d0e1796645799ef6de3a86ffc12a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:23.252842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 913/1830] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:22 2022] DELETE /identity/v3/users/3e21d0e1796645799ef6de3a86ffc12a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:24.787625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:24.789117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:24.811511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bb0a8-bc52-4273-a0be-da57f59326fb admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:24.980798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:24.981833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:24.982377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:24.982882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] PATH_INFO: `/v3/projects/00a7029d66134168b74c543c7018a3f4` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:24.985786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a7029d66134168b74c543c7018a3f4)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:24.989036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:25.089785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a7029d66134168b74c543c7018a3f4', 'request_id': 'req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:25.102843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a7029d66134168b74c543c7018a3f4', 'request_id': 'req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:25.110804 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a7029d66134168b74c543c7018a3f4', 'request_id': 'req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:25.129840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] The token cache is being invalidate because project 00a7029d66134168b74c543c7018a3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:25.131184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:25.132078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b1278c13-d508-4cb8-88d4-61cf26fdd7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:25.135179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 918/1831] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:24 2022] DELETE /identity/v3/projects/00a7029d66134168b74c543c7018a3f4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:25.140163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36422e2-122c-4a5e-a5ca-e1a7271a77a4 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.140624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36422e2-122c-4a5e-a5ca-e1a7271a77a4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.140700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36422e2-122c-4a5e-a5ca-e1a7271a77a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.193350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e36422e2-122c-4a5e-a5ca-e1a7271a77a4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:25.194626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e36422e2-122c-4a5e-a5ca-e1a7271a77a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:25.323806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 914/1832] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:25.332905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace305-b265-460d-b235-bd1624d567d6 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.333187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace305-b265-460d-b235-bd1624d567d6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.333523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace305-b265-460d-b235-bd1624d567d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.365728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9eace305-b265-460d-b235-bd1624d567d6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:25.367056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9eace305-b265-460d-b235-bd1624d567d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:25.377250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 919/1833] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:25.382490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36422e2-122c-4a5e-a5ca-e1a7271a77a4 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:25.392763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36422e2-122c-4a5e-a5ca-e1a7271a77a4 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:25.397824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:25.398463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.399277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.399277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.399667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:25.400199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:25.402170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:25.418121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 915/1834] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:29:25.419977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace305-b265-460d-b235-bd1624d567d6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:25.430461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace305-b265-460d-b235-bd1624d567d6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:25.435692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a1d09-693c-4377-aaa8-d22ed097f66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:25.436762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1d09-693c-4377-aaa8-d22ed097f66d admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.436762 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1d09-693c-4377-aaa8-d22ed097f66d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.436953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1d09-693c-4377-aaa8-d22ed097f66d admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.437494 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a1d09-693c-4377-aaa8-d22ed097f66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:25.439537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a1d09-693c-4377-aaa8-d22ed097f66d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:25.470104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 920/1835] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:25 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:25.472888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:25.483780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed70f-8401-4f63-a6fc-8a4fc5fd4a8e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:25.598141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615256e3-0113-4cbb-8a79-a012a010c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:25.599037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615256e3-0113-4cbb-8a79-a012a010c6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.599326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615256e3-0113-4cbb-8a79-a012a010c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.599614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615256e3-0113-4cbb-8a79-a012a010c6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.600556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615256e3-0113-4cbb-8a79-a012a010c6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:25.602788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615256e3-0113-4cbb-8a79-a012a010c6b2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:25.613000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:25.629371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 916/1836] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:25 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:25.633486 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a1d09-693c-4377-aaa8-d22ed097f66d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:25.646276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a1d09-693c-4377-aaa8-d22ed097f66d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:25.651429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd0511-1a3e-40b4-a326-9a4d4c0c8872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:25.652051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd0511-1a3e-40b4-a326-9a4d4c0c8872 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.652198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd0511-1a3e-40b4-a326-9a4d4c0c8872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.652476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd0511-1a3e-40b4-a326-9a4d4c0c8872 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.653124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd0511-1a3e-40b4-a326-9a4d4c0c8872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:25.654816 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd0511-1a3e-40b4-a326-9a4d4c0c8872 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:25.670602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 921/1837] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:25.672034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615256e3-0113-4cbb-8a79-a012a010c6b2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:25.687555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615256e3-0113-4cbb-8a79-a012a010c6b2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:25.694329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60e919-d1c4-43b7-917b-bdc31df768b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:25.696288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60e919-d1c4-43b7-917b-bdc31df768b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.696574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60e919-d1c4-43b7-917b-bdc31df768b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.696938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60e919-d1c4-43b7-917b-bdc31df768b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.697659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60e919-d1c4-43b7-917b-bdc31df768b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:25.699464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60e919-d1c4-43b7-917b-bdc31df768b2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:25.715709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 917/1838] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:25.717143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd0511-1a3e-40b4-a326-9a4d4c0c8872 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:25.728568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd0511-1a3e-40b4-a326-9a4d4c0c8872 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:25.734336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7c5db-1ce3-4947-a696-37e0ad9b7ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:25.735107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c5db-1ce3-4947-a696-37e0ad9b7ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.735488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c5db-1ce3-4947-a696-37e0ad9b7ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.735659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c5db-1ce3-4947-a696-37e0ad9b7ebf admin admin] PATH_INFO: `/v3/projects/2f322188afd7409a86b77d34ede3e5ff/users/6825a21ee06447f8be547687cc31737e/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.754361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7c5db-1ce3-4947-a696-37e0ad9b7ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f322188afd7409a86b77d34ede3e5ff, user_id=6825a21ee06447f8be547687cc31737e, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:25.758537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7c5db-1ce3-4947-a696-37e0ad9b7ebf admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:25.796881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 922/1839] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:25 2022] PUT /identity/v3/projects/2f322188afd7409a86b77d34ede3e5ff/users/6825a21ee06447f8be547687cc31737e/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:25.810327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03038e-ff81-46e5-8ee8-da8af24b75f0 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:25.810633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03038e-ff81-46e5-8ee8-da8af24b75f0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:25.811097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03038e-ff81-46e5-8ee8-da8af24b75f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:25.880992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-2a03038e-ff81-46e5-8ee8-da8af24b75f0 None None] MFA Rules not processed for user `6825a21ee06447f8be547687cc31737e`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:25.885770 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-2a03038e-ff81-46e5-8ee8-da8af24b75f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:25.996531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 918/1840] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:26.001218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7c5db-1ce3-4947-a696-37e0ad9b7ebf admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.015128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:26.068079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7c5db-1ce3-4947-a696-37e0ad9b7ebf admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.072805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12f31-6f79-42f5-8aa8-3a64af686685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.073403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12f31-6f79-42f5-8aa8-3a64af686685 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.073681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12f31-6f79-42f5-8aa8-3a64af686685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.073949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12f31-6f79-42f5-8aa8-3a64af686685 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.074615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d12f31-6f79-42f5-8aa8-3a64af686685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.076503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d12f31-6f79-42f5-8aa8-3a64af686685 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.109502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 923/1841] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:26 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:26.110720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03038e-ff81-46e5-8ee8-da8af24b75f0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.124167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03038e-ff81-46e5-8ee8-da8af24b75f0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.185964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22f824-bc60-4ff9-b35b-93f8b905def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.186613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22f824-bc60-4ff9-b35b-93f8b905def6 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.187080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22f824-bc60-4ff9-b35b-93f8b905def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.187503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22f824-bc60-4ff9-b35b-93f8b905def6 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.188349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22f824-bc60-4ff9-b35b-93f8b905def6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.190853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22f824-bc60-4ff9-b35b-93f8b905def6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.229185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 919/1842] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:26 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:26.233201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12f31-6f79-42f5-8aa8-3a64af686685 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.245309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12f31-6f79-42f5-8aa8-3a64af686685 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.250256 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76865f38-e531-47c6-bda7-a7d79b30bc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.250874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76865f38-e531-47c6-bda7-a7d79b30bc4f admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.251156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76865f38-e531-47c6-bda7-a7d79b30bc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.251456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76865f38-e531-47c6-bda7-a7d79b30bc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.252099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76865f38-e531-47c6-bda7-a7d79b30bc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.254435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76865f38-e531-47c6-bda7-a7d79b30bc4f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.270953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 924/1843] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:26.275263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22f824-bc60-4ff9-b35b-93f8b905def6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.285342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22f824-bc60-4ff9-b35b-93f8b905def6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.292733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3917-826f-4857-b096-e2a872ffb9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.293465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3917-826f-4857-b096-e2a872ffb9de admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.294606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3917-826f-4857-b096-e2a872ffb9de admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.294974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3917-826f-4857-b096-e2a872ffb9de admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.295848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c3917-826f-4857-b096-e2a872ffb9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.303115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c3917-826f-4857-b096-e2a872ffb9de admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.320876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 920/1844] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:26.324939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76865f38-e531-47c6-bda7-a7d79b30bc4f admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.335884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76865f38-e531-47c6-bda7-a7d79b30bc4f admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.340512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59eb8-4809-470d-9346-a9943ad12969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.341164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59eb8-4809-470d-9346-a9943ad12969 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.341444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59eb8-4809-470d-9346-a9943ad12969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.341719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59eb8-4809-470d-9346-a9943ad12969 admin admin] PATH_INFO: `/v3/projects/6d6ae5c01bd54c3493980709c94583f3/users/2c9ee382bd734d8296d4df83544ef65e/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.356821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59eb8-4809-470d-9346-a9943ad12969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6ae5c01bd54c3493980709c94583f3, user_id=2c9ee382bd734d8296d4df83544ef65e, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.359642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59eb8-4809-470d-9346-a9943ad12969 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.373428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 925/1845] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:26 2022] PUT /identity/v3/projects/6d6ae5c01bd54c3493980709c94583f3/users/2c9ee382bd734d8296d4df83544ef65e/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:26.383910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1751c-5c96-4f19-ad8e-7e51029d8751 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.384341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1751c-5c96-4f19-ad8e-7e51029d8751 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.384623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1751c-5c96-4f19-ad8e-7e51029d8751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.413834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7eb1751c-5c96-4f19-ad8e-7e51029d8751 None None] MFA Rules not processed for user `2c9ee382bd734d8296d4df83544ef65e`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:26.415087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7eb1751c-5c96-4f19-ad8e-7e51029d8751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:26.450192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:26.484720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 921/1846] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:26.489123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59eb8-4809-470d-9346-a9943ad12969 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.561758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59eb8-4809-470d-9346-a9943ad12969 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.567593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9963c73-8b19-41a6-9d9c-afb79a75ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.568386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963c73-8b19-41a6-9d9c-afb79a75ee5f admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.568871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963c73-8b19-41a6-9d9c-afb79a75ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.569202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963c73-8b19-41a6-9d9c-afb79a75ee5f admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.569812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9963c73-8b19-41a6-9d9c-afb79a75ee5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.571742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9963c73-8b19-41a6-9d9c-afb79a75ee5f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.601042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 926/1847] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:26 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:26.605310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1751c-5c96-4f19-ad8e-7e51029d8751 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.619322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1751c-5c96-4f19-ad8e-7e51029d8751 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.689248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f274d-539b-43d7-9008-c3c8cd6c3c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.689972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f274d-539b-43d7-9008-c3c8cd6c3c77 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.690334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f274d-539b-43d7-9008-c3c8cd6c3c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.691290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f274d-539b-43d7-9008-c3c8cd6c3c77 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.692054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f274d-539b-43d7-9008-c3c8cd6c3c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.694033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f274d-539b-43d7-9008-c3c8cd6c3c77 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.718792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 922/1848] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:26 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:26.723190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9963c73-8b19-41a6-9d9c-afb79a75ee5f admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.733635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9963c73-8b19-41a6-9d9c-afb79a75ee5f admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.738821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58744646-0868-4b10-bfff-304e5985aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.739434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58744646-0868-4b10-bfff-304e5985aeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.741460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58744646-0868-4b10-bfff-304e5985aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.741774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58744646-0868-4b10-bfff-304e5985aeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.742461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58744646-0868-4b10-bfff-304e5985aeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.745387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58744646-0868-4b10-bfff-304e5985aeb0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.757496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 927/1849] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:26.761487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f274d-539b-43d7-9008-c3c8cd6c3c77 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.772912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f274d-539b-43d7-9008-c3c8cd6c3c77 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.777556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9374-632e-4ab7-97d8-7e2549d0568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.778264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9374-632e-4ab7-97d8-7e2549d0568c admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.778542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9374-632e-4ab7-97d8-7e2549d0568c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.778813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9374-632e-4ab7-97d8-7e2549d0568c admin admin] PATH_INFO: `/v3/projects/e8f4af0f24394537a5c0edccf6448756/users/f533903ec3104d3dabbed9f6959c01b4/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.795071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9374-632e-4ab7-97d8-7e2549d0568c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f4af0f24394537a5c0edccf6448756, user_id=f533903ec3104d3dabbed9f6959c01b4, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.797729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9374-632e-4ab7-97d8-7e2549d0568c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.817659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58744646-0868-4b10-bfff-304e5985aeb0 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.818535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 923/1850] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:26 2022] PUT /identity/v3/projects/e8f4af0f24394537a5c0edccf6448756/users/f533903ec3104d3dabbed9f6959c01b4/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:26.827839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58744646-0868-4b10-bfff-304e5985aeb0 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.878996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:26.912045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302ed45-c11a-45fa-95c4-0d0c8e73301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.912784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ed45-c11a-45fa-95c4-0d0c8e73301e admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.913141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ed45-c11a-45fa-95c4-0d0c8e73301e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.913489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ed45-c11a-45fa-95c4-0d0c8e73301e admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.914289 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302ed45-c11a-45fa-95c4-0d0c8e73301e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.916246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302ed45-c11a-45fa-95c4-0d0c8e73301e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.930440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 928/1851] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:26.936807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9374-632e-4ab7-97d8-7e2549d0568c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:26.948314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9374-632e-4ab7-97d8-7e2549d0568c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:26.957448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:26.958449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.958909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.959392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] PATH_INFO: `/v3/projects/e8f4af0f24394537a5c0edccf6448756/users/f533903ec3104d3dabbed9f6959c01b4/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:26.961711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f4af0f24394537a5c0edccf6448756, user_id=f533903ec3104d3dabbed9f6959c01b4, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:26.964961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:26.986419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 924/1852] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:26 2022] PUT /identity/v3/projects/e8f4af0f24394537a5c0edccf6448756/users/f533903ec3104d3dabbed9f6959c01b4/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:26.997940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d856da-74ea-4f43-9709-dbe6e3c0b89d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:26.998304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d856da-74ea-4f43-9709-dbe6e3c0b89d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:26.998743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d856da-74ea-4f43-9709-dbe6e3c0b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:27.069820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-78d856da-74ea-4f43-9709-dbe6e3c0b89d None None] MFA Rules not processed for user `f533903ec3104d3dabbed9f6959c01b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:27.071493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-78d856da-74ea-4f43-9709-dbe6e3c0b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:27.157596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 929/1853] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:27.169586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:27.171651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:27.237399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bac8d2-5a3c-45c8-bc37-8cba033b8f9e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:27.241454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a4170-9161-4fad-9359-3c4fbe780d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:27.242235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a4170-9161-4fad-9359-3c4fbe780d2a service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:27.242741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a4170-9161-4fad-9359-3c4fbe780d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:27.243234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a4170-9161-4fad-9359-3c4fbe780d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:27.298802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:27.318390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a4170-9161-4fad-9359-3c4fbe780d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:27.320088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a4170-9161-4fad-9359-3c4fbe780d2a service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:27.330281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 925/1854] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:28.919500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d856da-74ea-4f43-9709-dbe6e3c0b89d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:28.929373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d856da-74ea-4f43-9709-dbe6e3c0b89d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:28.933028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:28.933629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:28.933911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:28.934222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:28.989497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:28.990961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:28.999646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 930/1855] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:29.574258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a4170-9161-4fad-9359-3c4fbe780d2a service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:29.584555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a4170-9161-4fad-9359-3c4fbe780d2a service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:29.588371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487575f-60c7-42fc-a89b-86dc20a615eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:29.588963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487575f-60c7-42fc-a89b-86dc20a615eb service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:29.589718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487575f-60c7-42fc-a89b-86dc20a615eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:29.589832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487575f-60c7-42fc-a89b-86dc20a615eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:29.605260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487575f-60c7-42fc-a89b-86dc20a615eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:29.606734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487575f-60c7-42fc-a89b-86dc20a615eb service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:29.617950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 926/1856] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:30.312011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:30.313576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:30.377214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:30.382384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d8da2-9995-40b2-a5d1-6b91587dfd54 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:30.387047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:30.387678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:30.387961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:30.388241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] PATH_INFO: `/v3/users/4f8ea8f502794c03a6914ff4bbd39a4f` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:30.389354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8ea8f502794c03a6914ff4bbd39a4f)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:30.391291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:30.437100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8ea8f502794c03a6914ff4bbd39a4f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:30.444728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8ea8f502794c03a6914ff4bbd39a4f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:30.445364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8ea8f502794c03a6914ff4bbd39a4f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:30.445982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8ea8f502794c03a6914ff4bbd39a4f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:30.457781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8ea8f502794c03a6914ff4bbd39a4f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:30.474982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 931/1857] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:30 2022] DELETE /identity/v3/users/4f8ea8f502794c03a6914ff4bbd39a4f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:30.479472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c59cc-eb28-48d3-aa9b-1b696388d920 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:30.479764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c59cc-eb28-48d3-aa9b-1b696388d920 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:30.480039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c59cc-eb28-48d3-aa9b-1b696388d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:30.499882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-5e9c59cc-eb28-48d3-aa9b-1b696388d920 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:30.501089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5e9c59cc-eb28-48d3-aa9b-1b696388d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:30.560342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 927/1858] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:30.570632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:30.572009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:30.629726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceccd0a-0bd0-44d9-983d-b70568ba0c35 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:30.633358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95af813-0ab7-4a58-940d-c6974493097f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:30.633969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af813-0ab7-4a58-940d-c6974493097f service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:30.634278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af813-0ab7-4a58-940d-c6974493097f service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:30.634553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af813-0ab7-4a58-940d-c6974493097f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:30.644443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95af813-0ab7-4a58-940d-c6974493097f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:30.647339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95af813-0ab7-4a58-940d-c6974493097f service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:30.657342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 932/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:29:31.118405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c59cc-eb28-48d3-aa9b-1b696388d920 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:31.121266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5e9c59cc-eb28-48d3-aa9b-1b696388d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:31.135277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c59cc-eb28-48d3-aa9b-1b696388d920 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:31.143086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:31.145618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:31.146119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:31.146707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] PATH_INFO: `/v3/projects/33928c2444dd44f2bad45fb5f544da07` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:31.148877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33928c2444dd44f2bad45fb5f544da07)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:31.152561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:31.212673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33928c2444dd44f2bad45fb5f544da07', 'request_id': 'req-78df6bc6-ed12-4fae-b547-20c5233c840b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.218353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33928c2444dd44f2bad45fb5f544da07', 'request_id': 'req-78df6bc6-ed12-4fae-b547-20c5233c840b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.225469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33928c2444dd44f2bad45fb5f544da07', 'request_id': 'req-78df6bc6-ed12-4fae-b547-20c5233c840b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.238454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] The token cache is being invalidate because project 33928c2444dd44f2bad45fb5f544da07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:31.238674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.239313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.241490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 928/1860] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:31 2022] DELETE /identity/v3/projects/33928c2444dd44f2bad45fb5f544da07 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:31.245633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95af813-0ab7-4a58-940d-c6974493097f service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:31.255436 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95af813-0ab7-4a58-940d-c6974493097f service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:31.311276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:31.311878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:31.312171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:31.312753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] PATH_INFO: `/v3/users/112d1133f16840c2be295c4d573dd911` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:31.313544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=112d1133f16840c2be295c4d573dd911)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:31.315523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:31.340019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:31.369593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112d1133f16840c2be295c4d573dd911'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.378345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112d1133f16840c2be295c4d573dd911'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.378975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112d1133f16840c2be295c4d573dd911'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.380698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112d1133f16840c2be295c4d573dd911'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.392201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-133e2d03-4fa9-47fb-92b6-8de5d9d2c01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112d1133f16840c2be295c4d573dd911'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.405193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 933/1861] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:31 2022] DELETE /identity/v3/users/112d1133f16840c2be295c4d573dd911 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:31.801179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:31.806124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:31.819300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df6bc6-ed12-4fae-b547-20c5233c840b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:31.874000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:31.885303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:31.886032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:31.886418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:31.886768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] PATH_INFO: `/v3/projects/5f9e5f201b6b4b0d96cafcb3a35531ec` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:31.888008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9e5f201b6b4b0d96cafcb3a35531ec)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:31.889997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:31.938679 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9e5f201b6b4b0d96cafcb3a35531ec', 'request_id': 'req-bf918d3d-8c15-4f29-a565-c9017c9e30b1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.944882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9e5f201b6b4b0d96cafcb3a35531ec', 'request_id': 'req-bf918d3d-8c15-4f29-a565-c9017c9e30b1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.951487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9e5f201b6b4b0d96cafcb3a35531ec', 'request_id': 'req-bf918d3d-8c15-4f29-a565-c9017c9e30b1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.970286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] The token cache is being invalidate because project 5f9e5f201b6b4b0d96cafcb3a35531ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:31.970739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.971477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-bf918d3d-8c15-4f29-a565-c9017c9e30b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:31.973632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 929/1862] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:31 2022] DELETE /identity/v3/projects/5f9e5f201b6b4b0d96cafcb3a35531ec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:31.978580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcd4e3-2fca-444d-9c49-ca83a5648236 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:31.979124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcd4e3-2fca-444d-9c49-ca83a5648236 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:31.979491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcd4e3-2fca-444d-9c49-ca83a5648236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:31.999095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-73fcd4e3-2fca-444d-9c49-ca83a5648236 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:32.000405 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-73fcd4e3-2fca-444d-9c49-ca83a5648236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:32.063269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 934/1863] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:32.070971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7acf7-d077-4196-b2b5-aece99bf4779 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.071343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7acf7-d077-4196-b2b5-aece99bf4779 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.071690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7acf7-d077-4196-b2b5-aece99bf4779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.094264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-98f7acf7-d077-4196-b2b5-aece99bf4779 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:32.095456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-98f7acf7-d077-4196-b2b5-aece99bf4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:32.110387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 930/1864] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:32.115567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcd4e3-2fca-444d-9c49-ca83a5648236 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.121230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcd4e3-2fca-444d-9c49-ca83a5648236 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.125723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.126367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.126646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.126915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.127585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:32.127919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.129491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.141772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 935/1865] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:32.146751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7acf7-d077-4196-b2b5-aece99bf4779 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.156129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7acf7-d077-4196-b2b5-aece99bf4779 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.161779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96156e3b-07dd-4bb6-bc04-da509f1ac65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.162435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96156e3b-07dd-4bb6-bc04-da509f1ac65a admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.162714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96156e3b-07dd-4bb6-bc04-da509f1ac65a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.162987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96156e3b-07dd-4bb6-bc04-da509f1ac65a admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.163636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96156e3b-07dd-4bb6-bc04-da509f1ac65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.165552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96156e3b-07dd-4bb6-bc04-da509f1ac65a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.207142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 931/1866] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:32 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:32.208346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.218726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78e141-ea08-4887-b99b-a67209cef092 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.294820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459589-3ebf-44dc-897a-d9a873fcd0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.295902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459589-3ebf-44dc-897a-d9a873fcd0dd admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.296188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459589-3ebf-44dc-897a-d9a873fcd0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.296463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459589-3ebf-44dc-897a-d9a873fcd0dd admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.297094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73459589-3ebf-44dc-897a-d9a873fcd0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.299044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73459589-3ebf-44dc-897a-d9a873fcd0dd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.327567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 936/1867] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:32 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:32.332272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96156e3b-07dd-4bb6-bc04-da509f1ac65a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.343634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96156e3b-07dd-4bb6-bc04-da509f1ac65a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.349468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1aa69-7f3b-4f1c-b6ea-c86f65da1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.350234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1aa69-7f3b-4f1c-b6ea-c86f65da1885 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.350621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1aa69-7f3b-4f1c-b6ea-c86f65da1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.351153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1aa69-7f3b-4f1c-b6ea-c86f65da1885 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.351980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1aa69-7f3b-4f1c-b6ea-c86f65da1885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.353690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1aa69-7f3b-4f1c-b6ea-c86f65da1885 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.364564 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 932/1868] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:32.369130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459589-3ebf-44dc-897a-d9a873fcd0dd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.380452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459589-3ebf-44dc-897a-d9a873fcd0dd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.385144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa2f3a-89c1-4760-b3c7-5b448070bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.385821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2f3a-89c1-4760-b3c7-5b448070bf7f admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.386132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2f3a-89c1-4760-b3c7-5b448070bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.386409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2f3a-89c1-4760-b3c7-5b448070bf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.387045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa2f3a-89c1-4760-b3c7-5b448070bf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.388608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa2f3a-89c1-4760-b3c7-5b448070bf7f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.400987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 937/1869] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:32.404935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1aa69-7f3b-4f1c-b6ea-c86f65da1885 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.414773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1aa69-7f3b-4f1c-b6ea-c86f65da1885 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.419522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee0a67-ba0b-4c61-b49d-8a41013e97ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.421181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee0a67-ba0b-4c61-b49d-8a41013e97ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.421577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee0a67-ba0b-4c61-b49d-8a41013e97ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.422262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee0a67-ba0b-4c61-b49d-8a41013e97ae admin admin] PATH_INFO: `/v3/projects/fa2676e826f04c8f88276de064e8f727/users/ad4e734cfdde4235a31c0da731edf4ba/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.438963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee0a67-ba0b-4c61-b49d-8a41013e97ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2676e826f04c8f88276de064e8f727, user_id=ad4e734cfdde4235a31c0da731edf4ba, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.442286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee0a67-ba0b-4c61-b49d-8a41013e97ae admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.460441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 933/1870] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:32 2022] PUT /identity/v3/projects/fa2676e826f04c8f88276de064e8f727/users/ad4e734cfdde4235a31c0da731edf4ba/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:32.472163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833252-cdeb-4191-a18c-28ede69bda71 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.472456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833252-cdeb-4191-a18c-28ede69bda71 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.472733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833252-cdeb-4191-a18c-28ede69bda71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.481223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:32.507655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e1833252-cdeb-4191-a18c-28ede69bda71 None None] MFA Rules not processed for user `ad4e734cfdde4235a31c0da731edf4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:32.509122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e1833252-cdeb-4191-a18c-28ede69bda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:32.581558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 938/1871] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:32.586647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee0a67-ba0b-4c61-b49d-8a41013e97ae admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.672866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee0a67-ba0b-4c61-b49d-8a41013e97ae admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.683439 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b3e5-47f5-484f-b233-204736d5c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.684146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b3e5-47f5-484f-b233-204736d5c73f admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.684528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b3e5-47f5-484f-b233-204736d5c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.684876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b3e5-47f5-484f-b233-204736d5c73f admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.685711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296b3e5-47f5-484f-b233-204736d5c73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.687685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296b3e5-47f5-484f-b233-204736d5c73f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.717004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 934/1872] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:32 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:32.721087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1833252-cdeb-4191-a18c-28ede69bda71 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.733767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1833252-cdeb-4191-a18c-28ede69bda71 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.796986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190419e8-1f20-48ae-b9f2-980441a354bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.797634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190419e8-1f20-48ae-b9f2-980441a354bb admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.797915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190419e8-1f20-48ae-b9f2-980441a354bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.798239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190419e8-1f20-48ae-b9f2-980441a354bb admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.798863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190419e8-1f20-48ae-b9f2-980441a354bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.801286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190419e8-1f20-48ae-b9f2-980441a354bb admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.827501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 939/1873] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:32 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:32.828711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b3e5-47f5-484f-b233-204736d5c73f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.835569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:32.840107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b3e5-47f5-484f-b233-204736d5c73f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.846360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16c93-6bf4-4416-8a8a-5e715a516218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.847179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16c93-6bf4-4416-8a8a-5e715a516218 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.847528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16c93-6bf4-4416-8a8a-5e715a516218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.847907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16c93-6bf4-4416-8a8a-5e715a516218 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.848620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b16c93-6bf4-4416-8a8a-5e715a516218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.850401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b16c93-6bf4-4416-8a8a-5e715a516218 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.869261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 935/1874] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:32.874296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190419e8-1f20-48ae-b9f2-980441a354bb admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:32.886729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190419e8-1f20-48ae-b9f2-980441a354bb admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:32.909039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ccd7d-3ffe-45bb-b086-4f1b489446e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:32.914981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ccd7d-3ffe-45bb-b086-4f1b489446e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:32.915372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ccd7d-3ffe-45bb-b086-4f1b489446e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:32.915649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ccd7d-3ffe-45bb-b086-4f1b489446e6 admin admin] PATH_INFO: `/v3/projects/098378b26ecb4eebba3f6642302bdc48/users/9fc1f8135c6e49c88da5b9d49e0755ed/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:32.943985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ccd7d-3ffe-45bb-b086-4f1b489446e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098378b26ecb4eebba3f6642302bdc48, user_id=9fc1f8135c6e49c88da5b9d49e0755ed, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:32.947831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ccd7d-3ffe-45bb-b086-4f1b489446e6 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:32.982448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 940/1875] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:32 2022] PUT /identity/v3/projects/098378b26ecb4eebba3f6642302bdc48/users/9fc1f8135c6e49c88da5b9d49e0755ed/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:32.986525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16c93-6bf4-4416-8a8a-5e715a516218 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:33.016507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16c93-6bf4-4416-8a8a-5e715a516218 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:33.118571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab12dfe-33f7-4863-b070-5ef9e37266c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:33.119330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12dfe-33f7-4863-b070-5ef9e37266c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.119648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12dfe-33f7-4863-b070-5ef9e37266c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.119893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12dfe-33f7-4863-b070-5ef9e37266c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.120621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab12dfe-33f7-4863-b070-5ef9e37266c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:33.122331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab12dfe-33f7-4863-b070-5ef9e37266c2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:33.138601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 936/1876] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:33.139293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ccd7d-3ffe-45bb-b086-4f1b489446e6 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:33.153128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ccd7d-3ffe-45bb-b086-4f1b489446e6 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:33.159729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:33.161813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.162263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.163043 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] PATH_INFO: `/v3/projects/098378b26ecb4eebba3f6642302bdc48/users/9fc1f8135c6e49c88da5b9d49e0755ed/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.166592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098378b26ecb4eebba3f6642302bdc48, user_id=9fc1f8135c6e49c88da5b9d49e0755ed, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:33.169687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:33.195836 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 941/1877] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:33 2022] PUT /identity/v3/projects/098378b26ecb4eebba3f6642302bdc48/users/9fc1f8135c6e49c88da5b9d49e0755ed/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:33.196930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3409-3313-43d2-8c75-187f9b32f28c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.197384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3409-3313-43d2-8c75-187f9b32f28c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.197487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3409-3313-43d2-8c75-187f9b32f28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.244550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b8de3409-3313-43d2-8c75-187f9b32f28c None None] MFA Rules not processed for user `9fc1f8135c6e49c88da5b9d49e0755ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:33.246008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b8de3409-3313-43d2-8c75-187f9b32f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:33.321839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 937/1878] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:33.333956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:33.335746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:33.390038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:33.397032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae27fb-b125-453d-9063-d69e1adbf6c9 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:33.401324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:33.401937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.402254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.402530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.412868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:33.414456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:33.429254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 942/1879] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:33.497385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3409-3313-43d2-8c75-187f9b32f28c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:33.579079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3409-3313-43d2-8c75-187f9b32f28c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:33.584588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:33.585327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.585677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.586028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] PATH_INFO: `/v3/users/ad4e734cfdde4235a31c0da731edf4ba` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.587340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4e734cfdde4235a31c0da731edf4ba)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:33.589420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:33.606331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:33.608122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:33.609621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:33.632226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17adf62-5c00-4970-b59f-5d470e31c7e3 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:33.644725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:33.645370 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.645660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.646751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] PATH_INFO: `/v3/users/6825a21ee06447f8be547687cc31737e` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.648717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6825a21ee06447f8be547687cc31737e)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:33.653328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:33.661659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4e734cfdde4235a31c0da731edf4ba'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.672742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4e734cfdde4235a31c0da731edf4ba'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.673402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4e734cfdde4235a31c0da731edf4ba'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.685266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4e734cfdde4235a31c0da731edf4ba'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.702449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6b843e57-91f3-4271-a851-8b98900d383c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4e734cfdde4235a31c0da731edf4ba'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.709734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 938/1880] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:33 2022] DELETE /identity/v3/users/ad4e734cfdde4235a31c0da731edf4ba => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:33.713580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6825a21ee06447f8be547687cc31737e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.713803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1cd2-6cbc-47bd-8f3c-e481f4716e40 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.714114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1cd2-6cbc-47bd-8f3c-e481f4716e40 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.714392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1cd2-6cbc-47bd-8f3c-e481f4716e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.724132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6825a21ee06447f8be547687cc31737e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.724132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6825a21ee06447f8be547687cc31737e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.724589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6825a21ee06447f8be547687cc31737e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.736052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f2da1cd2-6cbc-47bd-8f3c-e481f4716e40 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:33.738789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f2da1cd2-6cbc-47bd-8f3c-e481f4716e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:33.738917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0f7cd890-9a9f-48f9-aba2-d8bbdb6319e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6825a21ee06447f8be547687cc31737e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:33.750359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 943/1881] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:33 2022] DELETE /identity/v3/users/6825a21ee06447f8be547687cc31737e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:33.755105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a03e-d309-4cfe-95e3-f53a53f07c19 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.755394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a03e-d309-4cfe-95e3-f53a53f07c19 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.755668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a03e-d309-4cfe-95e3-f53a53f07c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.776673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-aa17a03e-d309-4cfe-95e3-f53a53f07c19 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:33.777879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-aa17a03e-d309-4cfe-95e3-f53a53f07c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:33.800601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 939/1882] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:33.815141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da1cd2-6cbc-47bd-8f3c-e481f4716e40 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:33.817160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f2da1cd2-6cbc-47bd-8f3c-e481f4716e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:33.846302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 944/1883] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:33.862375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a03e-d309-4cfe-95e3-f53a53f07c19 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:33.863909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-aa17a03e-d309-4cfe-95e3-f53a53f07c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:33.887299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da1cd2-6cbc-47bd-8f3c-e481f4716e40 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:33.929728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a03e-d309-4cfe-95e3-f53a53f07c19 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:33.933562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:33.934258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.934824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.934824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.943940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:33.944553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:33.944800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:33.944899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:33.945098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:33.946378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:33.951096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:33.955065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:33.957730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:33.958168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 945/1884] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:33.968719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 940/1885] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:34.548756 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:34.552909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:34.582601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:34.584052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:34.598753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:34.613294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481f45-cf32-4be6-887b-19971ea8c592 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:34.617218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121633cd-0419-4dab-a594-064965c3763d service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:34.621602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:34.623255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:34.623500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:34.623883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] PATH_INFO: `/v3/projects/2f322188afd7409a86b77d34ede3e5ff` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:34.624916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f322188afd7409a86b77d34ede3e5ff)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:34.626876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:34.631206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:34.631861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:34.632139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:34.635256 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] PATH_INFO: `/v3/projects/fa2676e826f04c8f88276de064e8f727` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:34.637810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2676e826f04c8f88276de064e8f727)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:34.645239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:34.729476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f322188afd7409a86b77d34ede3e5ff', 'request_id': 'req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.734210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2676e826f04c8f88276de064e8f727', 'request_id': 'req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.741194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f322188afd7409a86b77d34ede3e5ff', 'request_id': 'req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.741918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2676e826f04c8f88276de064e8f727', 'request_id': 'req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.749630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2676e826f04c8f88276de064e8f727', 'request_id': 'req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.757520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f322188afd7409a86b77d34ede3e5ff', 'request_id': 'req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.777175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] The token cache is being invalidate because project fa2676e826f04c8f88276de064e8f727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:34.777575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.778278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.779258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] The token cache is being invalidate because project 2f322188afd7409a86b77d34ede3e5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:34.779631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.782497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 946/1886] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:34 2022] DELETE /identity/v3/projects/fa2676e826f04c8f88276de064e8f727 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:34.782909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.784612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:34.786524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 941/1887] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:34 2022] DELETE /identity/v3/projects/2f322188afd7409a86b77d34ede3e5ff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:34.787658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:34.790037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:34.791727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:34.882750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4283-577f-4b21-b1a6-0b0730dfac4a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:34.891667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:34.892366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:34.892646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:34.892981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] PATH_INFO: `/v3/users/2c9ee382bd734d8296d4df83544ef65e` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:34.896466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9ee382bd734d8296d4df83544ef65e)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:34.897976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9bba0-1f3c-49ae-b117-766ed69a53cf admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:34.899312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:34.904515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:34.905291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:34.906002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:34.906002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] PATH_INFO: `/v3/users/9fc1f8135c6e49c88da5b9d49e0755ed` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:34.907281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc1f8135c6e49c88da5b9d49e0755ed)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:34.909407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:34.963516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9ee382bd734d8296d4df83544ef65e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.975785 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9ee382bd734d8296d4df83544ef65e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.976235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc1f8135c6e49c88da5b9d49e0755ed'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.976653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9ee382bd734d8296d4df83544ef65e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.986934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9ee382bd734d8296d4df83544ef65e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.991763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc1f8135c6e49c88da5b9d49e0755ed'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.992522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc1f8135c6e49c88da5b9d49e0755ed'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:34.993200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc1f8135c6e49c88da5b9d49e0755ed'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.014148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:35.015446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc1f8135c6e49c88da5b9d49e0755ed'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.015803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9ee382bd734d8296d4df83544ef65e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.028754 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 942/1888] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:34 2022] DELETE /identity/v3/users/2c9ee382bd734d8296d4df83544ef65e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:35.042106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 947/1889] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:34 2022] DELETE /identity/v3/users/9fc1f8135c6e49c88da5b9d49e0755ed => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:35.439498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:35.441156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:35.492236 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:35.493651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:35.507607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:35.534677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53035e-bc4e-4a18-8e5a-3f932164c6e0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:35.580715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950915-8014-46ed-8020-cc6997cb64c7 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:35.585805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:35.586469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:35.586749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:35.587032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] PATH_INFO: `/v3/projects/098378b26ecb4eebba3f6642302bdc48` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:35.588139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098378b26ecb4eebba3f6642302bdc48)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:35.590030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:35.599442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:35.600188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:35.600468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:35.600740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] PATH_INFO: `/v3/projects/6d6ae5c01bd54c3493980709c94583f3` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:35.601919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6ae5c01bd54c3493980709c94583f3)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:35.604471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:35.643865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098378b26ecb4eebba3f6642302bdc48', 'request_id': 'req-a719a95c-f6a7-4184-ad56-05175576ce89'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.649795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098378b26ecb4eebba3f6642302bdc48', 'request_id': 'req-a719a95c-f6a7-4184-ad56-05175576ce89'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.657374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098378b26ecb4eebba3f6642302bdc48', 'request_id': 'req-a719a95c-f6a7-4184-ad56-05175576ce89'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.658415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6ae5c01bd54c3493980709c94583f3', 'request_id': 'req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.665998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6ae5c01bd54c3493980709c94583f3', 'request_id': 'req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.672628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] The token cache is being invalidate because project 098378b26ecb4eebba3f6642302bdc48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:35.673278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.673989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a719a95c-f6a7-4184-ad56-05175576ce89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.675801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 948/1890] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:35 2022] DELETE /identity/v3/projects/098378b26ecb4eebba3f6642302bdc48 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:35.675926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6ae5c01bd54c3493980709c94583f3', 'request_id': 'req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.680127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be706-364c-4827-ab41-98997dbdbcf8 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:35.680384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be706-364c-4827-ab41-98997dbdbcf8 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:35.680659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be706-364c-4827-ab41-98997dbdbcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:35.691294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] The token cache is being invalidate because project 6d6ae5c01bd54c3493980709c94583f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:35.691648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.692400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.694596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 943/1891] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:35 2022] DELETE /identity/v3/projects/6d6ae5c01bd54c3493980709c94583f3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:35.698831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:35.700624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:35.703726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-bc1be706-364c-4827-ab41-98997dbdbcf8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:35.704927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bc1be706-364c-4827-ab41-98997dbdbcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:35.748028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:35.788949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe0361-f377-4d13-af40-39c4fb5e4aa3 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:35.792977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 949/1892] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:35.795233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:35.796270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:35.796652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:35.797053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] PATH_INFO: `/v3/users/f533903ec3104d3dabbed9f6959c01b4` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:35.798576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f533903ec3104d3dabbed9f6959c01b4)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:35.801507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6ea2d-9626-4a00-bcf7-c0e9a1b00893 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:35.802283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6ea2d-9626-4a00-bcf7-c0e9a1b00893 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:35.802283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6ea2d-9626-4a00-bcf7-c0e9a1b00893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:35.803223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:35.833305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-0bd6ea2d-9626-4a00-bcf7-c0e9a1b00893 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:35.834906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0bd6ea2d-9626-4a00-bcf7-c0e9a1b00893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:35.844956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 950/1893] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:35.854149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6ea2d-9626-4a00-bcf7-c0e9a1b00893 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:35.880292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6ea2d-9626-4a00-bcf7-c0e9a1b00893 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:35.887993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:35.888787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:35.889081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:35.889375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:35.889991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:35.890236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f533903ec3104d3dabbed9f6959c01b4'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.890346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:35.892590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:35.901191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f533903ec3104d3dabbed9f6959c01b4'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.902183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f533903ec3104d3dabbed9f6959c01b4'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.907305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 951/1894] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:35.910548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f533903ec3104d3dabbed9f6959c01b4'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.911978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:35.914758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:35.924394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f533903ec3104d3dabbed9f6959c01b4'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:35.933159 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 944/1895] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:35 2022] DELETE /identity/v3/users/f533903ec3104d3dabbed9f6959c01b4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:35.941597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4db4e-f4ca-4939-a177-498c224a9142 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:35.962482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:36.010852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778736-41f5-416c-b2f6-8ff96e37c185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.011471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778736-41f5-416c-b2f6-8ff96e37c185 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.011771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778736-41f5-416c-b2f6-8ff96e37c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.012172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778736-41f5-416c-b2f6-8ff96e37c185 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.012911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0778736-41f5-416c-b2f6-8ff96e37c185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.014938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0778736-41f5-416c-b2f6-8ff96e37c185 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.054005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 952/1896] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:35 2022] POST /identity/v3/projects => generated 389 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:36.058622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.072335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa7219-3d76-4bab-a317-98629f5fb4bc admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.145086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdf12d-6046-4e19-bd07-f21ca3435851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.145953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf12d-6046-4e19-bd07-f21ca3435851 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.146320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf12d-6046-4e19-bd07-f21ca3435851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.146752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf12d-6046-4e19-bd07-f21ca3435851 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.147490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdf12d-6046-4e19-bd07-f21ca3435851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.149850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdf12d-6046-4e19-bd07-f21ca3435851 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.178245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 945/1897] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:36 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:36.182922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778736-41f5-416c-b2f6-8ff96e37c185 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.197235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778736-41f5-416c-b2f6-8ff96e37c185 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.207243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eae3a-2dea-4485-a9c8-1e4136c0f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.208915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eae3a-2dea-4485-a9c8-1e4136c0f397 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.209515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eae3a-2dea-4485-a9c8-1e4136c0f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.210092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eae3a-2dea-4485-a9c8-1e4136c0f397 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.212337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eae3a-2dea-4485-a9c8-1e4136c0f397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.214682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eae3a-2dea-4485-a9c8-1e4136c0f397 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.230581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 953/1898] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:36.234823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdf12d-6046-4e19-bd07-f21ca3435851 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.246976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdf12d-6046-4e19-bd07-f21ca3435851 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.253421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c9f2b-3b79-496e-8226-d537d5959392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.254392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9f2b-3b79-496e-8226-d537d5959392 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.254947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9f2b-3b79-496e-8226-d537d5959392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.255348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9f2b-3b79-496e-8226-d537d5959392 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.256304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c9f2b-3b79-496e-8226-d537d5959392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.258376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c9f2b-3b79-496e-8226-d537d5959392 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.271863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 946/1899] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:36.276306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eae3a-2dea-4485-a9c8-1e4136c0f397 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.288722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eae3a-2dea-4485-a9c8-1e4136c0f397 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.294055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.294477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.294833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.295204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] PATH_INFO: `/v3/projects/63d48beeba284db5b362e1162ac4b177/users/48f210e7dc914356af6feb29dfb3123b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.315728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d48beeba284db5b362e1162ac4b177, user_id=48f210e7dc914356af6feb29dfb3123b, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.318519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.334284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 954/1900] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:36 2022] PUT /identity/v3/projects/63d48beeba284db5b362e1162ac4b177/users/48f210e7dc914356af6feb29dfb3123b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:36.347061 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8673-b5a6-4614-8833-8100e781643e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.347353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8673-b5a6-4614-8833-8100e781643e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.347632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8673-b5a6-4614-8833-8100e781643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.351690 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.353641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:36.394585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-71cf8673-b5a6-4614-8833-8100e781643e None None] MFA Rules not processed for user `48f210e7dc914356af6feb29dfb3123b`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:36.395811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-71cf8673-b5a6-4614-8833-8100e781643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:36.419077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:36.476049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19e377-e11a-4a76-9c6f-5c4c59c6cc7d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.481182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.481832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.482191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.482472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] PATH_INFO: `/v3/projects/e8f4af0f24394537a5c0edccf6448756` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.483718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f4af0f24394537a5c0edccf6448756)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.485660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.535648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 947/1901] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:36.536799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8673-b5a6-4614-8833-8100e781643e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.561109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8673-b5a6-4614-8833-8100e781643e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.571399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb5c8-b2c2-4eec-b982-71e08604d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.572326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb5c8-b2c2-4eec-b982-71e08604d51b admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.574096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb5c8-b2c2-4eec-b982-71e08604d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.574963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb5c8-b2c2-4eec-b982-71e08604d51b admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.576387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cb5c8-b2c2-4eec-b982-71e08604d51b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.583018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cb5c8-b2c2-4eec-b982-71e08604d51b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.618081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f4af0f24394537a5c0edccf6448756', 'request_id': 'req-ef7f6794-2075-4284-8509-5758fa51810b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:36.627640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 948/1902] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:36 2022] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:36.628991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f4af0f24394537a5c0edccf6448756', 'request_id': 'req-ef7f6794-2075-4284-8509-5758fa51810b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:36.629759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb5c8-b2c2-4eec-b982-71e08604d51b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.642996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f4af0f24394537a5c0edccf6448756', 'request_id': 'req-ef7f6794-2075-4284-8509-5758fa51810b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:36.660451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:36.673586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] The token cache is being invalidate because project e8f4af0f24394537a5c0edccf6448756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:36.673586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:36.697896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ef7f6794-2075-4284-8509-5758fa51810b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:36.701238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 955/1903] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:36 2022] DELETE /identity/v3/projects/e8f4af0f24394537a5c0edccf6448756 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:36.705188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08f7f-e3b3-411b-971e-b69ebcd7a146 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.706022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08f7f-e3b3-411b-971e-b69ebcd7a146 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.706689 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08f7f-e3b3-411b-971e-b69ebcd7a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.731105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6fb08f7f-e3b3-411b-971e-b69ebcd7a146 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:36.732581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6fb08f7f-e3b3-411b-971e-b69ebcd7a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:36.761986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb5c8-b2c2-4eec-b982-71e08604d51b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.769299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.769934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.770255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.770533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.771166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.773106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.807414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 949/1904] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:36 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:36.811975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.814093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:36.845318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d989b9-8224-463d-ade3-f432b1cfc784 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.866755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488d6ac-b3fa-4efa-b100-c5f4d152727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.867036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488d6ac-b3fa-4efa-b100-c5f4d152727f admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.867319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488d6ac-b3fa-4efa-b100-c5f4d152727f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.867597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488d6ac-b3fa-4efa-b100-c5f4d152727f admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.870394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 956/1905] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:36.873851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488d6ac-b3fa-4efa-b100-c5f4d152727f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.875633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488d6ac-b3fa-4efa-b100-c5f4d152727f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.878647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959a75b-250e-47be-9734-b266f438022b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.879057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959a75b-250e-47be-9734-b266f438022b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.879730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959a75b-250e-47be-9734-b266f438022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.904852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 950/1906] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:36.909397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9959a75b-250e-47be-9734-b266f438022b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:36.910351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488d6ac-b3fa-4efa-b100-c5f4d152727f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.910989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9959a75b-250e-47be-9734-b266f438022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:36.921661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 957/1907] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:36.926714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959a75b-250e-47be-9734-b266f438022b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:36.943792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488d6ac-b3fa-4efa-b100-c5f4d152727f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.956710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959a75b-250e-47be-9734-b266f438022b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:36.957539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b655139-839e-42b5-a4ca-fdbaf46a6a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.958404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b655139-839e-42b5-a4ca-fdbaf46a6a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.958693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b655139-839e-42b5-a4ca-fdbaf46a6a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.958965 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b655139-839e-42b5-a4ca-fdbaf46a6a6b admin admin] PATH_INFO: `/v3/projects/32c7d5e8c55a4b71bd5f9f3f55ff8a9b/users/fd9b275ecd974f13ac499c70e3a84d1e/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.968977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:36.970165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:36.970593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:36.972530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:36.974475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:36.978427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.982173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:36.993951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b655139-839e-42b5-a4ca-fdbaf46a6a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c7d5e8c55a4b71bd5f9f3f55ff8a9b, user_id=fd9b275ecd974f13ac499c70e3a84d1e, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:36.996694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b655139-839e-42b5-a4ca-fdbaf46a6a6b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.012965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 958/1908] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:37.015383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.027255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 951/1909] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:36 2022] PUT /identity/v3/projects/32c7d5e8c55a4b71bd5f9f3f55ff8a9b/users/fd9b275ecd974f13ac499c70e3a84d1e/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:37.030887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b655139-839e-42b5-a4ca-fdbaf46a6a6b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.044163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38f48-ae78-4c4e-9187-c772a1acde4e admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.136021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491056d3-5f41-43bf-974a-6878da3a704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.136724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491056d3-5f41-43bf-974a-6878da3a704c admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.137076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491056d3-5f41-43bf-974a-6878da3a704c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.137419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491056d3-5f41-43bf-974a-6878da3a704c admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.138172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491056d3-5f41-43bf-974a-6878da3a704c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.140267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491056d3-5f41-43bf-974a-6878da3a704c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.146924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:37.167819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b655139-839e-42b5-a4ca-fdbaf46a6a6b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.173275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d606d-9410-479a-9637-c96600d2cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.173906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d606d-9410-479a-9637-c96600d2cdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.174243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d606d-9410-479a-9637-c96600d2cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.175251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d606d-9410-479a-9637-c96600d2cdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.175921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d606d-9410-479a-9637-c96600d2cdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.177551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d606d-9410-479a-9637-c96600d2cdd2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.185134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 959/1910] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:37 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:37.189861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491056d3-5f41-43bf-974a-6878da3a704c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.194408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 952/1911] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:37.198959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d606d-9410-479a-9637-c96600d2cdd2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.212189 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d606d-9410-479a-9637-c96600d2cdd2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.304731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491056d3-5f41-43bf-974a-6878da3a704c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.310404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572fbed-a05f-43bd-8318-b51687e82ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.311305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572fbed-a05f-43bd-8318-b51687e82ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.311750 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572fbed-a05f-43bd-8318-b51687e82ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.312127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572fbed-a05f-43bd-8318-b51687e82ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.312945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572fbed-a05f-43bd-8318-b51687e82ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.316966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572fbed-a05f-43bd-8318-b51687e82ea4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.320555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2d128-bea3-4cb0-b587-c05142edcd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.321228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2d128-bea3-4cb0-b587-c05142edcd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.321509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2d128-bea3-4cb0-b587-c05142edcd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.321790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2d128-bea3-4cb0-b587-c05142edcd6e admin admin] PATH_INFO: `/v3/projects/32c7d5e8c55a4b71bd5f9f3f55ff8a9b/users/fd9b275ecd974f13ac499c70e3a84d1e/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.324014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2d128-bea3-4cb0-b587-c05142edcd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c7d5e8c55a4b71bd5f9f3f55ff8a9b, user_id=fd9b275ecd974f13ac499c70e3a84d1e, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.326553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:37.327291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2d128-bea3-4cb0-b587-c05142edcd6e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.345565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 953/1912] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:37 2022] PUT /identity/v3/projects/32c7d5e8c55a4b71bd5f9f3f55ff8a9b/users/fd9b275ecd974f13ac499c70e3a84d1e/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:37.346250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 960/1913] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:37 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:37.355951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab4934-02a9-41df-bbe7-6a2da881b565 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.356237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab4934-02a9-41df-bbe7-6a2da881b565 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.356514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab4934-02a9-41df-bbe7-6a2da881b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.357304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572fbed-a05f-43bd-8318-b51687e82ea4 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.376808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572fbed-a05f-43bd-8318-b51687e82ea4 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.391442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-9bab4934-02a9-41df-bbe7-6a2da881b565 None None] MFA Rules not processed for user `fd9b275ecd974f13ac499c70e3a84d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:37.394031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9bab4934-02a9-41df-bbe7-6a2da881b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:37.457923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c6d3c-7c85-43eb-9ac8-474b99532c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.458707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6d3c-7c85-43eb-9ac8-474b99532c27 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.459061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6d3c-7c85-43eb-9ac8-474b99532c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.459407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6d3c-7c85-43eb-9ac8-474b99532c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.460143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c6d3c-7c85-43eb-9ac8-474b99532c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.461846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c6d3c-7c85-43eb-9ac8-474b99532c27 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.476313 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 961/1914] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:37.481664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c6d3c-7c85-43eb-9ac8-474b99532c27 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.488316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 954/1915] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:37.499953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c6d3c-7c85-43eb-9ac8-474b99532c27 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.501363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab4934-02a9-41df-bbe7-6a2da881b565 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.504930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9bab4934-02a9-41df-bbe7-6a2da881b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:37.510663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046f704-ad4e-40ec-958f-1e568288abea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.511864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046f704-ad4e-40ec-958f-1e568288abea admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.512376 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046f704-ad4e-40ec-958f-1e568288abea admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.512876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046f704-ad4e-40ec-958f-1e568288abea admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.513726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046f704-ad4e-40ec-958f-1e568288abea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.516520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046f704-ad4e-40ec-958f-1e568288abea admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.530691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 962/1916] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:37.535086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046f704-ad4e-40ec-958f-1e568288abea admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.547357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046f704-ad4e-40ec-958f-1e568288abea admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.553522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df56ce8-f4ea-4ae8-9e4a-5256a015d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.554342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56ce8-f4ea-4ae8-9e4a-5256a015d2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.554673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56ce8-f4ea-4ae8-9e4a-5256a015d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.554936 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56ce8-f4ea-4ae8-9e4a-5256a015d2e3 admin admin] PATH_INFO: `/v3/projects/44f228e8755d4ce882e06af4d99544d9/users/7b4dc5b8745d483cb07e6bdef72d885d/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.576769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab4934-02a9-41df-bbe7-6a2da881b565 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.578725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df56ce8-f4ea-4ae8-9e4a-5256a015d2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f228e8755d4ce882e06af4d99544d9, user_id=7b4dc5b8745d483cb07e6bdef72d885d, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.582919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df56ce8-f4ea-4ae8-9e4a-5256a015d2e3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.584447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.585079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.585360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.585662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.595810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.597940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.606107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 963/1917] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:37 2022] PUT /identity/v3/projects/44f228e8755d4ce882e06af4d99544d9/users/7b4dc5b8745d483cb07e6bdef72d885d/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:37.608220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 955/1918] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:37.616686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b427b-db49-448b-9790-f77e5ee72725 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.617124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b427b-db49-448b-9790-f77e5ee72725 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.617225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b427b-db49-448b-9790-f77e5ee72725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.645301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f30b427b-db49-448b-9790-f77e5ee72725 None None] MFA Rules not processed for user `7b4dc5b8745d483cb07e6bdef72d885d`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:37.646533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f30b427b-db49-448b-9790-f77e5ee72725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:37.656947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.658384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:37.669928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433a58c-c101-478a-878f-90a4c867f85c service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.678607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:37.716238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 964/1919] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:37.717869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b427b-db49-448b-9790-f77e5ee72725 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.726678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.727378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.727663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.727967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.729729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:37.780521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:37.801446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b427b-db49-448b-9790-f77e5ee72725 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.805370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.806328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1d1c8-f32f-4640-8024-2907442e0219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.807023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d1c8-f32f-4640-8024-2907442e0219 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.807211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d1c8-f32f-4640-8024-2907442e0219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.807483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d1c8-f32f-4640-8024-2907442e0219 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.808113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1d1c8-f32f-4640-8024-2907442e0219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.810006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1d1c8-f32f-4640-8024-2907442e0219 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.811919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.823407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 956/1920] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:29:37.844163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 965/1921] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:37 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:37.845146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.860498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fafef5-6235-47c8-8efe-132a7b6ecde7 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.921266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9fc0-558c-4d9a-a785-e069103767c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.921887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9fc0-558c-4d9a-a785-e069103767c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.922203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9fc0-558c-4d9a-a785-e069103767c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.922483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9fc0-558c-4d9a-a785-e069103767c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.923118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9fc0-558c-4d9a-a785-e069103767c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.925092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9fc0-558c-4d9a-a785-e069103767c3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.948185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 957/1922] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:37 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:37.952201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1d1c8-f32f-4640-8024-2907442e0219 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:37.965513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1d1c8-f32f-4640-8024-2907442e0219 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:37.971056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42fa66-7559-4068-999e-e21255e00c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:37.972414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42fa66-7559-4068-999e-e21255e00c31 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:37.972703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42fa66-7559-4068-999e-e21255e00c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:37.972980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42fa66-7559-4068-999e-e21255e00c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:37.973653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42fa66-7559-4068-999e-e21255e00c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:37.975417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42fa66-7559-4068-999e-e21255e00c31 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:37.987392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 966/1923] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:37.991583 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9fc0-558c-4d9a-a785-e069103767c3 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.005275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9fc0-558c-4d9a-a785-e069103767c3 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.011989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa5de6-114a-4fef-a7ae-01d389d0b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.012701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa5de6-114a-4fef-a7ae-01d389d0b7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.013055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa5de6-114a-4fef-a7ae-01d389d0b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.013394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa5de6-114a-4fef-a7ae-01d389d0b7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.014204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa5de6-114a-4fef-a7ae-01d389d0b7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:38.015883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa5de6-114a-4fef-a7ae-01d389d0b7f4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:38.033636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 958/1924] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:38.039386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42fa66-7559-4068-999e-e21255e00c31 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.055331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42fa66-7559-4068-999e-e21255e00c31 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.060724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42962a41-93cd-4440-bdd7-f906a1f56965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.060724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42962a41-93cd-4440-bdd7-f906a1f56965 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.060724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42962a41-93cd-4440-bdd7-f906a1f56965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.060724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42962a41-93cd-4440-bdd7-f906a1f56965 admin admin] PATH_INFO: `/v3/projects/5fd8c997bd984b2695483543e6014844/users/3afa38ff0e0e4066beebdff78a0d760c/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.081743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42962a41-93cd-4440-bdd7-f906a1f56965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd8c997bd984b2695483543e6014844, user_id=3afa38ff0e0e4066beebdff78a0d760c, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:38.085366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42962a41-93cd-4440-bdd7-f906a1f56965 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:38.103651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 967/1925] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:38 2022] PUT /identity/v3/projects/5fd8c997bd984b2695483543e6014844/users/3afa38ff0e0e4066beebdff78a0d760c/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:38.117684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c290-e395-4452-ac56-2980ed1d7cdf None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.118098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c290-e395-4452-ac56-2980ed1d7cdf None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.118659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c290-e395-4452-ac56-2980ed1d7cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.162225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7763c290-e395-4452-ac56-2980ed1d7cdf None None] MFA Rules not processed for user `3afa38ff0e0e4066beebdff78a0d760c`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:38.163730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7763c290-e395-4452-ac56-2980ed1d7cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:38.202395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:38.256815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 959/1926] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:38.258532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42962a41-93cd-4440-bdd7-f906a1f56965 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.351073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42962a41-93cd-4440-bdd7-f906a1f56965 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.355964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4e7f-1372-4718-b910-39d31f49104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.356567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4e7f-1372-4718-b910-39d31f49104a admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.356852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4e7f-1372-4718-b910-39d31f49104a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.357162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4e7f-1372-4718-b910-39d31f49104a admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.357808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce4e7f-1372-4718-b910-39d31f49104a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:38.359764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce4e7f-1372-4718-b910-39d31f49104a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:38.392152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 968/1927] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:38 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:38.397535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c290-e395-4452-ac56-2980ed1d7cdf None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.413455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c290-e395-4452-ac56-2980ed1d7cdf None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.478947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c7964-7459-433d-9a94-9b37d67ce753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.479461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7964-7459-433d-9a94-9b37d67ce753 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.479742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7964-7459-433d-9a94-9b37d67ce753 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.480012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7964-7459-433d-9a94-9b37d67ce753 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.480643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c7964-7459-433d-9a94-9b37d67ce753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:38.482746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c7964-7459-433d-9a94-9b37d67ce753 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:38.504681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 960/1928] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:38 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:38.508701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4e7f-1372-4718-b910-39d31f49104a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.520155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4e7f-1372-4718-b910-39d31f49104a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.524911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad1833-1961-4877-acd9-a28a3042c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.525514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad1833-1961-4877-acd9-a28a3042c39a admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.525799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad1833-1961-4877-acd9-a28a3042c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.526087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad1833-1961-4877-acd9-a28a3042c39a admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.526724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad1833-1961-4877-acd9-a28a3042c39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:38.528305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad1833-1961-4877-acd9-a28a3042c39a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:38.540612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 969/1929] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:38.544636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c7964-7459-433d-9a94-9b37d67ce753 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.556523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c7964-7459-433d-9a94-9b37d67ce753 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.562472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ca512-b28c-42bb-97e7-fd79738d8cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.563212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ca512-b28c-42bb-97e7-fd79738d8cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.563497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ca512-b28c-42bb-97e7-fd79738d8cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.563771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ca512-b28c-42bb-97e7-fd79738d8cfd admin admin] PATH_INFO: `/v3/projects/3338858689d14836965b289e22b493dc/users/d14f63850c254ce5ae563d17653a3244/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.585829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ca512-b28c-42bb-97e7-fd79738d8cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3338858689d14836965b289e22b493dc, user_id=d14f63850c254ce5ae563d17653a3244, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:38.590911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ca512-b28c-42bb-97e7-fd79738d8cfd admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:38.619813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 961/1930] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:38 2022] PUT /identity/v3/projects/3338858689d14836965b289e22b493dc/users/d14f63850c254ce5ae563d17653a3244/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:38.630375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad1833-1961-4877-acd9-a28a3042c39a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.646662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad1833-1961-4877-acd9-a28a3042c39a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.713065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07864645-c741-4d0c-9416-7d75003aa18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.713674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07864645-c741-4d0c-9416-7d75003aa18a admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.713954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07864645-c741-4d0c-9416-7d75003aa18a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.714818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07864645-c741-4d0c-9416-7d75003aa18a admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.714995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07864645-c741-4d0c-9416-7d75003aa18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:38.716763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07864645-c741-4d0c-9416-7d75003aa18a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:38.728515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 970/1931] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:38.732392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ca512-b28c-42bb-97e7-fd79738d8cfd admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.748090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ca512-b28c-42bb-97e7-fd79738d8cfd admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.753749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04d8e2-fdf0-4526-8e81-4588e15c52e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.755379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04d8e2-fdf0-4526-8e81-4588e15c52e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.755663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04d8e2-fdf0-4526-8e81-4588e15c52e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.755937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04d8e2-fdf0-4526-8e81-4588e15c52e0 admin admin] PATH_INFO: `/v3/projects/3338858689d14836965b289e22b493dc/users/d14f63850c254ce5ae563d17653a3244/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.759122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04d8e2-fdf0-4526-8e81-4588e15c52e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3338858689d14836965b289e22b493dc, user_id=d14f63850c254ce5ae563d17653a3244, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:38.762603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04d8e2-fdf0-4526-8e81-4588e15c52e0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:38.787541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 962/1932] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:38 2022] PUT /identity/v3/projects/3338858689d14836965b289e22b493dc/users/d14f63850c254ce5ae563d17653a3244/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:38.788074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855a61-59cb-4ad6-b009-636f82e51769 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.788363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855a61-59cb-4ad6-b009-636f82e51769 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.788635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855a61-59cb-4ad6-b009-636f82e51769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:38.796630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:38.821198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-65855a61-59cb-4ad6-b009-636f82e51769 None None] MFA Rules not processed for user `d14f63850c254ce5ae563d17653a3244`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:38.822676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-65855a61-59cb-4ad6-b009-636f82e51769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:38.906997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 971/1933] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:38.919308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04d8e2-fdf0-4526-8e81-4588e15c52e0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:38.980565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04d8e2-fdf0-4526-8e81-4588e15c52e0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:38.984581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1bf35-2ee3-4151-836c-3791709a1d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:38.985201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1bf35-2ee3-4151-836c-3791709a1d4f service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:38.985599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1bf35-2ee3-4151-836c-3791709a1d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:38.985982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1bf35-2ee3-4151-836c-3791709a1d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:39.028749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:39.046789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1bf35-2ee3-4151-836c-3791709a1d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:39.048178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1bf35-2ee3-4151-836c-3791709a1d4f service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:39.061437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 963/1934] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:40.595425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855a61-59cb-4ad6-b009-636f82e51769 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:40.605145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855a61-59cb-4ad6-b009-636f82e51769 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:40.608680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6210f-ecc7-4f75-81e5-aa280a1d6dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:40.609266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6210f-ecc7-4f75-81e5-aa280a1d6dbd service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:40.609543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6210f-ecc7-4f75-81e5-aa280a1d6dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:40.609814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6210f-ecc7-4f75-81e5-aa280a1d6dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:40.669577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6210f-ecc7-4f75-81e5-aa280a1d6dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:40.671140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6210f-ecc7-4f75-81e5-aa280a1d6dbd service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:40.680544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 972/1935] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:41.266475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1bf35-2ee3-4151-836c-3791709a1d4f service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:41.276258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1bf35-2ee3-4151-836c-3791709a1d4f service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:41.280210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa51798-3ce1-4f6a-adbc-3ad93f0c1c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:41.280951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa51798-3ce1-4f6a-adbc-3ad93f0c1c67 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:41.281082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa51798-3ce1-4f6a-adbc-3ad93f0c1c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:41.281351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa51798-3ce1-4f6a-adbc-3ad93f0c1c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:41.294170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa51798-3ce1-4f6a-adbc-3ad93f0c1c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:41.295992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa51798-3ce1-4f6a-adbc-3ad93f0c1c67 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:41.307881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 964/1936] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:41.427662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6210f-ecc7-4f75-81e5-aa280a1d6dbd service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:41.540992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6210f-ecc7-4f75-81e5-aa280a1d6dbd service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:41.546183 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:41.547003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:41.547546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:41.548012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] PATH_INFO: `/v3/users/48f210e7dc914356af6feb29dfb3123b` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:41.549396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f210e7dc914356af6feb29dfb3123b)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:41.551621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:41.593541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:41.608572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f210e7dc914356af6feb29dfb3123b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:41.622812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f210e7dc914356af6feb29dfb3123b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:41.624164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f210e7dc914356af6feb29dfb3123b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:41.626161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f210e7dc914356af6feb29dfb3123b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:41.655078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f210e7dc914356af6feb29dfb3123b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:41.668241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 973/1937] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:41 2022] DELETE /identity/v3/users/48f210e7dc914356af6feb29dfb3123b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:41.672510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28752-ce55-49ba-b3e8-e3fd387005b3 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:41.672776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28752-ce55-49ba-b3e8-e3fd387005b3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:41.673053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28752-ce55-49ba-b3e8-e3fd387005b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:41.699939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c4a28752-ce55-49ba-b3e8-e3fd387005b3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:41.701485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c4a28752-ce55-49ba-b3e8-e3fd387005b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:41.781950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 965/1938] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:41.793507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:41.795100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:41.869468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e7551-1abc-4f48-98be-83edb360ba30 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:41.873091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894e55-a568-47ff-91f6-556f2ff96fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:41.873958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894e55-a568-47ff-91f6-556f2ff96fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:41.874410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894e55-a568-47ff-91f6-556f2ff96fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:41.874813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894e55-a568-47ff-91f6-556f2ff96fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:41.886593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894e55-a568-47ff-91f6-556f2ff96fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:41.887999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894e55-a568-47ff-91f6-556f2ff96fa8 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:41.897498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 974/1939] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:42.331842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a28752-ce55-49ba-b3e8-e3fd387005b3 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:42.334003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c4a28752-ce55-49ba-b3e8-e3fd387005b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:42.347326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a28752-ce55-49ba-b3e8-e3fd387005b3 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:42.352581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:42.353225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:42.353505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:42.353777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] PATH_INFO: `/v3/projects/63d48beeba284db5b362e1162ac4b177` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:42.354975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d48beeba284db5b362e1162ac4b177)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:42.356908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:42.443099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d48beeba284db5b362e1162ac4b177', 'request_id': 'req-e0d03501-042c-456e-a2e8-60bb1caf78f4'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.459643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d48beeba284db5b362e1162ac4b177', 'request_id': 'req-e0d03501-042c-456e-a2e8-60bb1caf78f4'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.480408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d48beeba284db5b362e1162ac4b177', 'request_id': 'req-e0d03501-042c-456e-a2e8-60bb1caf78f4'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.501860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] The token cache is being invalidate because project 63d48beeba284db5b362e1162ac4b177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:42.502314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.503306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.506204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 966/1940] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:42 2022] DELETE /identity/v3/projects/63d48beeba284db5b362e1162ac4b177 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:42.511590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894e55-a568-47ff-91f6-556f2ff96fa8 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:42.529496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894e55-a568-47ff-91f6-556f2ff96fa8 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:42.682398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:42.683114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:42.683601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:42.683964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] PATH_INFO: `/v3/users/fd9b275ecd974f13ac499c70e3a84d1e` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:42.685122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9b275ecd974f13ac499c70e3a84d1e)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:42.687779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:42.760779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9b275ecd974f13ac499c70e3a84d1e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.769411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:42.779633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9b275ecd974f13ac499c70e3a84d1e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.782168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9b275ecd974f13ac499c70e3a84d1e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.782759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9b275ecd974f13ac499c70e3a84d1e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.803999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3c01856f-d58c-42ec-b64a-c92a316dd44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9b275ecd974f13ac499c70e3a84d1e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:42.880592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 975/1941] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:42 2022] DELETE /identity/v3/users/fd9b275ecd974f13ac499c70e3a84d1e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:43.360319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:43.361914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:43.375393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d03501-042c-456e-a2e8-60bb1caf78f4 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:43.428116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:43.444888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:43.445559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:43.445821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:43.446276 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] PATH_INFO: `/v3/projects/32c7d5e8c55a4b71bd5f9f3f55ff8a9b` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:43.447456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c7d5e8c55a4b71bd5f9f3f55ff8a9b)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:43.449430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:43.513285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c7d5e8c55a4b71bd5f9f3f55ff8a9b', 'request_id': 'req-57571332-3f5a-4990-8a97-4d5d210da0f7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:43.520292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c7d5e8c55a4b71bd5f9f3f55ff8a9b', 'request_id': 'req-57571332-3f5a-4990-8a97-4d5d210da0f7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:43.527078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c7d5e8c55a4b71bd5f9f3f55ff8a9b', 'request_id': 'req-57571332-3f5a-4990-8a97-4d5d210da0f7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:43.542536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] The token cache is being invalidate because project 32c7d5e8c55a4b71bd5f9f3f55ff8a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:43.542826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:43.543457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-57571332-3f5a-4990-8a97-4d5d210da0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:43.544961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 967/1942] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:43 2022] DELETE /identity/v3/projects/32c7d5e8c55a4b71bd5f9f3f55ff8a9b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:43.550566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca404-3895-40dc-86af-8003aa2bf68f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:43.550986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca404-3895-40dc-86af-8003aa2bf68f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:43.551470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca404-3895-40dc-86af-8003aa2bf68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:43.573997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-89fca404-3895-40dc-86af-8003aa2bf68f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:43.575348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-89fca404-3895-40dc-86af-8003aa2bf68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:43.634826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 976/1943] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:43.642455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3861-b7ba-4845-8fd3-cf6a82fd682d None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:43.642769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3861-b7ba-4845-8fd3-cf6a82fd682d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:43.643633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3861-b7ba-4845-8fd3-cf6a82fd682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:43.674738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-4a5b3861-b7ba-4845-8fd3-cf6a82fd682d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:43.676180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4a5b3861-b7ba-4845-8fd3-cf6a82fd682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:43.685354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 968/1944] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:43.694401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fca404-3895-40dc-86af-8003aa2bf68f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:43.704363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fca404-3895-40dc-86af-8003aa2bf68f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:43.709859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:43.710500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:43.710785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:43.711063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:43.711708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:43.712016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:43.713601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:43.725342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 977/1945] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:43.729779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b3861-b7ba-4845-8fd3-cf6a82fd682d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:43.740723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b3861-b7ba-4845-8fd3-cf6a82fd682d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:43.745408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db31b2-3160-44b9-b7ac-753e32106e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:43.746022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db31b2-3160-44b9-b7ac-753e32106e34 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:43.746338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db31b2-3160-44b9-b7ac-753e32106e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:43.746617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db31b2-3160-44b9-b7ac-753e32106e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:43.747250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db31b2-3160-44b9-b7ac-753e32106e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:43.749179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db31b2-3160-44b9-b7ac-753e32106e34 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:43.779598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 969/1946] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:43 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:43.784454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:43.795130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a7ec3-33be-4eeb-b495-402ac371a728 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:43.869733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d244e-c3a5-480f-9c26-5ebc5f5c7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:43.870874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d244e-c3a5-480f-9c26-5ebc5f5c7fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:43.871182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d244e-c3a5-480f-9c26-5ebc5f5c7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:43.871567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d244e-c3a5-480f-9c26-5ebc5f5c7fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:43.872211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d244e-c3a5-480f-9c26-5ebc5f5c7fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:43.874392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d244e-c3a5-480f-9c26-5ebc5f5c7fd4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:43.897296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 978/1947] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:43 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:43.901547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db31b2-3160-44b9-b7ac-753e32106e34 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:43.912667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db31b2-3160-44b9-b7ac-753e32106e34 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:43.918104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1a211-c362-4ca3-a80b-79547eaf2de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:43.918631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a211-c362-4ca3-a80b-79547eaf2de9 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:43.918910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a211-c362-4ca3-a80b-79547eaf2de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:43.919181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a211-c362-4ca3-a80b-79547eaf2de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:43.920679 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1a211-c362-4ca3-a80b-79547eaf2de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:43.921438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1a211-c362-4ca3-a80b-79547eaf2de9 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:43.949253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 970/1948] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:43.953469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d244e-c3a5-480f-9c26-5ebc5f5c7fd4 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:43.968051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d244e-c3a5-480f-9c26-5ebc5f5c7fd4 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:43.973475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50409ff-4a36-4592-9090-b2dbc5457fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:43.974546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50409ff-4a36-4592-9090-b2dbc5457fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:43.974856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50409ff-4a36-4592-9090-b2dbc5457fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:43.975139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50409ff-4a36-4592-9090-b2dbc5457fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:43.975801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50409ff-4a36-4592-9090-b2dbc5457fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:43.977497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50409ff-4a36-4592-9090-b2dbc5457fa0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:43.994494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1a211-c362-4ca3-a80b-79547eaf2de9 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:43.999714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 979/1949] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:44.006432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1a211-c362-4ca3-a80b-79547eaf2de9 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:44.011582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:44.012246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:44.012531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:44.012809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] PATH_INFO: `/v3/projects/32e2285c3458498ea71472b34a6e0c62/users/2a7acb38d8af4034ac5dffc6d3c78d7a/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:44.030286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e2285c3458498ea71472b34a6e0c62, user_id=2a7acb38d8af4034ac5dffc6d3c78d7a, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:44.032974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:44.059514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 971/1950] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:43 2022] PUT /identity/v3/projects/32e2285c3458498ea71472b34a6e0c62/users/2a7acb38d8af4034ac5dffc6d3c78d7a/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:44.073102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87123-9743-49d0-910b-a4fd509e12e5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:44.073393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87123-9743-49d0-910b-a4fd509e12e5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:44.073677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87123-9743-49d0-910b-a4fd509e12e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:44.102779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e7b87123-9743-49d0-910b-a4fd509e12e5 None None] MFA Rules not processed for user `2a7acb38d8af4034ac5dffc6d3c78d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:44.103992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e7b87123-9743-49d0-910b-a4fd509e12e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:44.133315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:44.185391 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 980/1951] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:44.197462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:44.200547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:44.276428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4f1a6-9ebb-404b-a8b2-a26c25efe951 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:44.280384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e0556-82f0-4d5e-b1b8-97e3fa83f1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:44.281135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e0556-82f0-4d5e-b1b8-97e3fa83f1ed service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:44.282046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e0556-82f0-4d5e-b1b8-97e3fa83f1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:44.282046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e0556-82f0-4d5e-b1b8-97e3fa83f1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:44.293317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e0556-82f0-4d5e-b1b8-97e3fa83f1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:44.295004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e0556-82f0-4d5e-b1b8-97e3fa83f1ed service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:44.305210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 972/1952] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:45.620101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87123-9743-49d0-910b-a4fd509e12e5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:45.621549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e7b87123-9743-49d0-910b-a4fd509e12e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:45.733514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87123-9743-49d0-910b-a4fd509e12e5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:45.739133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:45.739770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:45.740203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:45.740501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] PATH_INFO: `/v3/users/7b4dc5b8745d483cb07e6bdef72d885d` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:45.742413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4dc5b8745d483cb07e6bdef72d885d)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:45.744399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:45.814660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4dc5b8745d483cb07e6bdef72d885d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:45.827436 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4dc5b8745d483cb07e6bdef72d885d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:45.828146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4dc5b8745d483cb07e6bdef72d885d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:45.829317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4dc5b8745d483cb07e6bdef72d885d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:45.845157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4dc5b8745d483cb07e6bdef72d885d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:45.879791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 981/1953] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:45 2022] DELETE /identity/v3/users/7b4dc5b8745d483cb07e6bdef72d885d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:45.884513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549f370-a486-47ad-8a58-571d4726e0e6 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:45.885147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549f370-a486-47ad-8a58-571d4726e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:45.885147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549f370-a486-47ad-8a58-571d4726e0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:45.910888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f549f370-a486-47ad-8a58-571d4726e0e6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:45.912823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f549f370-a486-47ad-8a58-571d4726e0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:45.930705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:46.020733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 973/1954] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:46.030637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:46.035584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:46.107185 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:46.125784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d337cc-5c4b-4fcd-9113-3e0d04495146 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:46.133061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216159-bc4d-4c39-892f-ed9c80f39565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:46.133945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216159-bc4d-4c39-892f-ed9c80f39565 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:46.134926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216159-bc4d-4c39-892f-ed9c80f39565 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:46.134926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216159-bc4d-4c39-892f-ed9c80f39565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:46.160542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b216159-bc4d-4c39-892f-ed9c80f39565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:46.163523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b216159-bc4d-4c39-892f-ed9c80f39565 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:46.182575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 982/1955] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:46.619657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549f370-a486-47ad-8a58-571d4726e0e6 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:46.621765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f549f370-a486-47ad-8a58-571d4726e0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:46.644315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549f370-a486-47ad-8a58-571d4726e0e6 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:46.653226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:46.655016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:46.656022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:46.656480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] PATH_INFO: `/v3/projects/44f228e8755d4ce882e06af4d99544d9` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:46.658897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f228e8755d4ce882e06af4d99544d9)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:46.660863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:46.721980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f228e8755d4ce882e06af4d99544d9', 'request_id': 'req-e84241d0-d18b-4b74-9697-fd0365368be6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:46.734545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f228e8755d4ce882e06af4d99544d9', 'request_id': 'req-e84241d0-d18b-4b74-9697-fd0365368be6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:46.743881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f228e8755d4ce882e06af4d99544d9', 'request_id': 'req-e84241d0-d18b-4b74-9697-fd0365368be6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:46.769803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] The token cache is being invalidate because project 44f228e8755d4ce882e06af4d99544d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:46.770362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:46.771362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:46.773715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 974/1956] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:46 2022] DELETE /identity/v3/projects/44f228e8755d4ce882e06af4d99544d9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:46.777838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216159-bc4d-4c39-892f-ed9c80f39565 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:46.798270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216159-bc4d-4c39-892f-ed9c80f39565 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:46.911763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:46.912431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:46.912715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:46.913155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] PATH_INFO: `/v3/users/3afa38ff0e0e4066beebdff78a0d760c` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:46.914461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afa38ff0e0e4066beebdff78a0d760c)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:46.916507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:47.024699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afa38ff0e0e4066beebdff78a0d760c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.040656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afa38ff0e0e4066beebdff78a0d760c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.041361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afa38ff0e0e4066beebdff78a0d760c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.042044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afa38ff0e0e4066beebdff78a0d760c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.076535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afa38ff0e0e4066beebdff78a0d760c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.104727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 983/1957] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:46 2022] DELETE /identity/v3/users/3afa38ff0e0e4066beebdff78a0d760c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:47.425596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:47.427116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:47.441858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84241d0-d18b-4b74-9697-fd0365368be6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:47.513015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:47.513660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:47.513945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:47.514265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] PATH_INFO: `/v3/projects/5fd8c997bd984b2695483543e6014844` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:47.515927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd8c997bd984b2695483543e6014844)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:47.517652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:47.578853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:47.582486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd8c997bd984b2695483543e6014844', 'request_id': 'req-8e2e38eb-d64c-412a-845c-1e34d18db794'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.590983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd8c997bd984b2695483543e6014844', 'request_id': 'req-8e2e38eb-d64c-412a-845c-1e34d18db794'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.601604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd8c997bd984b2695483543e6014844', 'request_id': 'req-8e2e38eb-d64c-412a-845c-1e34d18db794'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.620867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] The token cache is being invalidate because project 5fd8c997bd984b2695483543e6014844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:47.621321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.622490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.625197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 975/1958] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:47 2022] DELETE /identity/v3/projects/5fd8c997bd984b2695483543e6014844 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:47.629378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:47.630970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:47.651295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7680-9124-49a5-a03d-1f9e11fd04c9 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:47.677432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:47.679129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:47.743648 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:47.744844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:47.745171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:47.745531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] PATH_INFO: `/v3/users/d14f63850c254ce5ae563d17653a3244` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:47.749525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14f63850c254ce5ae563d17653a3244)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:47.755449 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:47.761732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:47.827328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e38eb-d64c-412a-845c-1e34d18db794 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:47.835280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14f63850c254ce5ae563d17653a3244'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.838044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:47.838714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:47.838992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:47.839474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] PATH_INFO: `/v3/users/2a7acb38d8af4034ac5dffc6d3c78d7a` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:47.842604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7acb38d8af4034ac5dffc6d3c78d7a)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:47.844912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:47.853119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14f63850c254ce5ae563d17653a3244'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.853846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14f63850c254ce5ae563d17653a3244'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.855041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14f63850c254ce5ae563d17653a3244'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.882539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-41a18fed-9531-40d8-ac94-43c5457c6386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14f63850c254ce5ae563d17653a3244'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.912975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 984/1959] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:47 2022] DELETE /identity/v3/users/d14f63850c254ce5ae563d17653a3244 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:47.970653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7acb38d8af4034ac5dffc6d3c78d7a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.983417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7acb38d8af4034ac5dffc6d3c78d7a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:47.988253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7acb38d8af4034ac5dffc6d3c78d7a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.009089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7acb38d8af4034ac5dffc6d3c78d7a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.038901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7acb38d8af4034ac5dffc6d3c78d7a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.049662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 976/1960] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:47 2022] DELETE /identity/v3/users/2a7acb38d8af4034ac5dffc6d3c78d7a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:48.051568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198d9f-161b-4f01-ad1f-889af3e7212a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.051964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198d9f-161b-4f01-ad1f-889af3e7212a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.052333 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198d9f-161b-4f01-ad1f-889af3e7212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.084129 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-7b198d9f-161b-4f01-ad1f-889af3e7212a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:48.085780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7b198d9f-161b-4f01-ad1f-889af3e7212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.173751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 985/1961] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:48.184141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:48.185643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.252007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863eb89-2026-423d-a486-d6f935565d24 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:48.258651 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826f011-3a34-4d02-9d1b-55ce2830de02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:48.259876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826f011-3a34-4d02-9d1b-55ce2830de02 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.260229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826f011-3a34-4d02-9d1b-55ce2830de02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.260571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826f011-3a34-4d02-9d1b-55ce2830de02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.272445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:48.276472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826f011-3a34-4d02-9d1b-55ce2830de02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:48.278903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826f011-3a34-4d02-9d1b-55ce2830de02 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:48.302237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 977/1962] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:48.341522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198d9f-161b-4f01-ad1f-889af3e7212a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:48.343967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7b198d9f-161b-4f01-ad1f-889af3e7212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.374223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198d9f-161b-4f01-ad1f-889af3e7212a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:48.397412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:48.398530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.398821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.400163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] PATH_INFO: `/v3/projects/3338858689d14836965b289e22b493dc` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.401579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3338858689d14836965b289e22b493dc)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:48.404339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:48.462814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3338858689d14836965b289e22b493dc', 'request_id': 'req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.469916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3338858689d14836965b289e22b493dc', 'request_id': 'req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.478960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3338858689d14836965b289e22b493dc', 'request_id': 'req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.500526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] The token cache is being invalidate because project 3338858689d14836965b289e22b493dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:48.500904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.501699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-20fb3199-4a44-4ddd-96f8-fa8a5541bf48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.504556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 986/1963] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:48 2022] DELETE /identity/v3/projects/3338858689d14836965b289e22b493dc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:48.509287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2779b-445d-45fb-82fd-a4b7133efae1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.509748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2779b-445d-45fb-82fd-a4b7133efae1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.510375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2779b-445d-45fb-82fd-a4b7133efae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.535357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f5b2779b-445d-45fb-82fd-a4b7133efae1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:48.537412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f5b2779b-445d-45fb-82fd-a4b7133efae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.659995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 978/1964] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:48.662400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d266fc-5fa5-49f5-acbb-3891191a4bc9 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.663680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d266fc-5fa5-49f5-acbb-3891191a4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.663680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d266fc-5fa5-49f5-acbb-3891191a4bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.684709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-78d266fc-5fa5-49f5-acbb-3891191a4bc9 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:48.685628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-78d266fc-5fa5-49f5-acbb-3891191a4bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.696273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2779b-445d-45fb-82fd-a4b7133efae1 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:48.698689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f5b2779b-445d-45fb-82fd-a4b7133efae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.702208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 987/1965] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:48.703462 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d266fc-5fa5-49f5-acbb-3891191a4bc9 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:48.708749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:48.715303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2779b-445d-45fb-82fd-a4b7133efae1 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:48.716367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d266fc-5fa5-49f5-acbb-3891191a4bc9 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:48.726488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:48.727546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:48.728171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.728481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.729008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.729724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.730396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] PATH_INFO: `/v3/projects/32e2285c3458498ea71472b34a6e0c62` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.732537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e2285c3458498ea71472b34a6e0c62)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:48.741036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:48.741156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.741820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:48.743033 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:48.745620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:48.763015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 988/1966] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:48.768603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:48.782904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda17466-9fe3-4cba-8eca-597b50ae0517 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:48.789349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3ef1-349d-4af8-b381-cc202764487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:48.790857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3ef1-349d-4af8-b381-cc202764487f admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.791302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3ef1-349d-4af8-b381-cc202764487f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.791738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3ef1-349d-4af8-b381-cc202764487f admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.792660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c3ef1-349d-4af8-b381-cc202764487f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:48.795883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c3ef1-349d-4af8-b381-cc202764487f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:48.832499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e2285c3458498ea71472b34a6e0c62', 'request_id': 'req-2835469d-e326-4530-839c-1fcfa8b0f81d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.843495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 989/1967] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:48 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:48.844468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3ef1-349d-4af8-b381-cc202764487f admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:48.845185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e2285c3458498ea71472b34a6e0c62', 'request_id': 'req-2835469d-e326-4530-839c-1fcfa8b0f81d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.864245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e2285c3458498ea71472b34a6e0c62', 'request_id': 'req-2835469d-e326-4530-839c-1fcfa8b0f81d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.879481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] The token cache is being invalidate because project 32e2285c3458498ea71472b34a6e0c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:48.879937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.880747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2835469d-e326-4530-839c-1fcfa8b0f81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:48.882453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 979/1968] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:48 2022] DELETE /identity/v3/projects/32e2285c3458498ea71472b34a6e0c62 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:48.887492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc388c45-d4b7-4589-b815-425161354a17 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.887790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc388c45-d4b7-4589-b815-425161354a17 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.888076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc388c45-d4b7-4589-b815-425161354a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.910271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-fc388c45-d4b7-4589-b815-425161354a17 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:48.912231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-fc388c45-d4b7-4589-b815-425161354a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.921472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3ef1-349d-4af8-b381-cc202764487f admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:48.929022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 980/1969] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:48.930530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f3555-9d5d-42f0-90f6-4d1f6471f98b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.930824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f3555-9d5d-42f0-90f6-4d1f6471f98b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.931102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f3555-9d5d-42f0-90f6-4d1f6471f98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.934399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419231c7-c9c4-4ed7-8500-7dc3637cdfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:48.935165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419231c7-c9c4-4ed7-8500-7dc3637cdfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.935452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419231c7-c9c4-4ed7-8500-7dc3637cdfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.935795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419231c7-c9c4-4ed7-8500-7dc3637cdfc3 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.936426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419231c7-c9c4-4ed7-8500-7dc3637cdfc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:48.938555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419231c7-c9c4-4ed7-8500-7dc3637cdfc3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:48.952696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-ff2f3555-9d5d-42f0-90f6-4d1f6471f98b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:48.954252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ff2f3555-9d5d-42f0-90f6-4d1f6471f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.963749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 981/1970] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:48.967311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 990/1971] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:48 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:48.968047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f3555-9d5d-42f0-90f6-4d1f6471f98b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:48.968158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419231c7-c9c4-4ed7-8500-7dc3637cdfc3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:48.969456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ff2f3555-9d5d-42f0-90f6-4d1f6471f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:48.980337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419231c7-c9c4-4ed7-8500-7dc3637cdfc3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:48.983039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f3555-9d5d-42f0-90f6-4d1f6471f98b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:48.985257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:48.985871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.986192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.986465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.987676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:48.987974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:48.988736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97f595-efb1-42db-b424-1b80b1b61697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:48.989432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f595-efb1-42db-b424-1b80b1b61697 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:48.989587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:48.989857 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f595-efb1-42db-b424-1b80b1b61697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:48.990250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f595-efb1-42db-b424-1b80b1b61697 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:48.990975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97f595-efb1-42db-b424-1b80b1b61697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:48.992760 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97f595-efb1-42db-b424-1b80b1b61697 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.003818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 982/1972] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:49.007244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 991/1973] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:49.010979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97f595-efb1-42db-b424-1b80b1b61697 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.011513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.022129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97f595-efb1-42db-b424-1b80b1b61697 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.023393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822397c2-5d34-4687-b696-f88f6d4b5dc0 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.027929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4a10-4856-489f-b06c-40b2bd3b535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.028777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4a10-4856-489f-b06c-40b2bd3b535b admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.029128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4a10-4856-489f-b06c-40b2bd3b535b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.029479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4a10-4856-489f-b06c-40b2bd3b535b admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.029901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c061b-b898-411f-afbc-81ff46a184b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.030301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4a10-4856-489f-b06c-40b2bd3b535b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.030960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c061b-b898-411f-afbc-81ff46a184b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.031252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c061b-b898-411f-afbc-81ff46a184b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.031531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c061b-b898-411f-afbc-81ff46a184b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.032174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c061b-b898-411f-afbc-81ff46a184b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.032281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4a10-4856-489f-b06c-40b2bd3b535b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.034757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c061b-b898-411f-afbc-81ff46a184b5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.052328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 983/1974] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:49.053532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4a10-4856-489f-b06c-40b2bd3b535b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.064835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4a10-4856-489f-b06c-40b2bd3b535b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.068479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 992/1975] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:49 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:49.072280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c061b-b898-411f-afbc-81ff46a184b5 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.073459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885370ba-89c4-4be7-925f-d7b7bf2eefba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.075224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885370ba-89c4-4be7-925f-d7b7bf2eefba admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.075602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885370ba-89c4-4be7-925f-d7b7bf2eefba admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.075966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885370ba-89c4-4be7-925f-d7b7bf2eefba admin admin] PATH_INFO: `/v3/projects/62d0bdd8084b4309a1bafc762bf0fb4f/users/c125b360114445ec936dc7bb35cf4dfe/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.092455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885370ba-89c4-4be7-925f-d7b7bf2eefba admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d0bdd8084b4309a1bafc762bf0fb4f, user_id=c125b360114445ec936dc7bb35cf4dfe, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.095390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885370ba-89c4-4be7-925f-d7b7bf2eefba admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.110453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 984/1976] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:49 2022] PUT /identity/v3/projects/62d0bdd8084b4309a1bafc762bf0fb4f/users/c125b360114445ec936dc7bb35cf4dfe/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:49.121285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66751-5840-4f48-b401-f56c7d48e867 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.121791 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66751-5840-4f48-b401-f56c7d48e867 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.122145 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66751-5840-4f48-b401-f56c7d48e867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.152286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-edf66751-5840-4f48-b401-f56c7d48e867 None None] MFA Rules not processed for user `c125b360114445ec936dc7bb35cf4dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:49.153513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-edf66751-5840-4f48-b401-f56c7d48e867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:49.160066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c061b-b898-411f-afbc-81ff46a184b5 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.164108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:49.192931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:49.242422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e60d8-df66-4547-887c-0629828a1012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.243197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e60d8-df66-4547-887c-0629828a1012 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.243480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e60d8-df66-4547-887c-0629828a1012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.243757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e60d8-df66-4547-887c-0629828a1012 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.244385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e60d8-df66-4547-887c-0629828a1012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.246281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 985/1977] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:49.246470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e60d8-df66-4547-887c-0629828a1012 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.259115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66751-5840-4f48-b401-f56c7d48e867 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.261900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-edf66751-5840-4f48-b401-f56c7d48e867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:49.272873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 993/1978] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:49 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:49.276371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e60d8-df66-4547-887c-0629828a1012 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.288233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e60d8-df66-4547-887c-0629828a1012 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.293401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9a51f-fb9e-4952-b38e-63ae524c1d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.294164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9a51f-fb9e-4952-b38e-63ae524c1d6b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.294988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9a51f-fb9e-4952-b38e-63ae524c1d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.294988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9a51f-fb9e-4952-b38e-63ae524c1d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.295887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9a51f-fb9e-4952-b38e-63ae524c1d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.297459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9a51f-fb9e-4952-b38e-63ae524c1d6b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.312195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 994/1979] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:49.313332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9a51f-fb9e-4952-b38e-63ae524c1d6b admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.329411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9a51f-fb9e-4952-b38e-63ae524c1d6b admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.337650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c044f5c-50d5-49e8-b8c8-667fd5cbd27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.338699 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c044f5c-50d5-49e8-b8c8-667fd5cbd27a admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.339140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c044f5c-50d5-49e8-b8c8-667fd5cbd27a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.339644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c044f5c-50d5-49e8-b8c8-667fd5cbd27a admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.340413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c044f5c-50d5-49e8-b8c8-667fd5cbd27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.342711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c044f5c-50d5-49e8-b8c8-667fd5cbd27a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.348882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66751-5840-4f48-b401-f56c7d48e867 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.353481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27df969-6240-4d97-bfc7-c32be1909f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.354129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df969-6240-4d97-bfc7-c32be1909f6a service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.354408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df969-6240-4d97-bfc7-c32be1909f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.354676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df969-6240-4d97-bfc7-c32be1909f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.356837 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 995/1980] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:29:49.360686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c044f5c-50d5-49e8-b8c8-667fd5cbd27a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.365756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27df969-6240-4d97-bfc7-c32be1909f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.367414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27df969-6240-4d97-bfc7-c32be1909f6a service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.370894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c044f5c-50d5-49e8-b8c8-667fd5cbd27a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.377825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 986/1981] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:29:49.377981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.378857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.379250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.379634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] PATH_INFO: `/v3/projects/9c1e7e8df475427f8f62ee12e0310228/users/b27fa7162c174f0eabf05cc752574d10/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.398946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1e7e8df475427f8f62ee12e0310228, user_id=b27fa7162c174f0eabf05cc752574d10, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.401596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.416249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 996/1982] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:49 2022] PUT /identity/v3/projects/9c1e7e8df475427f8f62ee12e0310228/users/b27fa7162c174f0eabf05cc752574d10/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:49.437602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b44d3-4f18-4896-86fe-a8c1f7b19816 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.437602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b44d3-4f18-4896-86fe-a8c1f7b19816 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.438038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b44d3-4f18-4896-86fe-a8c1f7b19816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.509677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-bb0b44d3-4f18-4896-86fe-a8c1f7b19816 None None] MFA Rules not processed for user `b27fa7162c174f0eabf05cc752574d10`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:49.512454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-bb0b44d3-4f18-4896-86fe-a8c1f7b19816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:49.613373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 987/1983] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:49.627693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.629678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:49.727562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee51f5-04bb-4531-9449-3e84970e03d5 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.732775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637e550-43ef-4032-a836-54106512dfad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.733479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e550-43ef-4032-a836-54106512dfad service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.733768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e550-43ef-4032-a836-54106512dfad service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.734104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e550-43ef-4032-a836-54106512dfad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.744069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637e550-43ef-4032-a836-54106512dfad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.745664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637e550-43ef-4032-a836-54106512dfad service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.755902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 997/1984] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:49.790330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b44d3-4f18-4896-86fe-a8c1f7b19816 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:49.862391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:49.893700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b44d3-4f18-4896-86fe-a8c1f7b19816 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:49.899381 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:49.900179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.900469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.900748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] PATH_INFO: `/v3/users/b27fa7162c174f0eabf05cc752574d10` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:49.901897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27fa7162c174f0eabf05cc752574d10)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:49.904815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:49.953448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27fa7162c174f0eabf05cc752574d10'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:49.961063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27fa7162c174f0eabf05cc752574d10'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:49.961698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27fa7162c174f0eabf05cc752574d10'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:49.968884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27fa7162c174f0eabf05cc752574d10'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:49.980965 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27fa7162c174f0eabf05cc752574d10'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:49.987408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 988/1985] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:49 2022] DELETE /identity/v3/users/b27fa7162c174f0eabf05cc752574d10 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:49.992069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfb982-af49-406a-8fa7-fdff9c1fdcb6 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:49.992545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfb982-af49-406a-8fa7-fdff9c1fdcb6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:49.992633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfb982-af49-406a-8fa7-fdff9c1fdcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:50.011776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-59dfb982-af49-406a-8fa7-fdff9c1fdcb6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:50.012974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-59dfb982-af49-406a-8fa7-fdff9c1fdcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:50.072477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 998/1986] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:50.082520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:50.083952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:50.141660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a913d-410a-4559-852c-70df80e60555 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:50.145592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:50.146233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:50.146518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:50.146791 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:50.155780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:50.157286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:50.166792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 989/1987] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:50.566727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfb982-af49-406a-8fa7-fdff9c1fdcb6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:50.568312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-59dfb982-af49-406a-8fa7-fdff9c1fdcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:50.586785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:50.627616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfb982-af49-406a-8fa7-fdff9c1fdcb6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:50.631330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:50.631941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:50.632218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:50.632489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:50.634237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:50.699090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:50.700555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:50.711296 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 999/1988] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:51.042295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:51.043712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:51.061958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83d31a-3dc7-4de6-b765-a3b41e387d8d service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:51.085369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:51.086048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:51.086336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:51.086586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] PATH_INFO: `/v3/projects/9c1e7e8df475427f8f62ee12e0310228` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:51.087811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1e7e8df475427f8f62ee12e0310228)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:51.089710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:51.156047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1e7e8df475427f8f62ee12e0310228', 'request_id': 'req-363e2362-878e-474a-86b7-c39f08623cb8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:51.163233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1e7e8df475427f8f62ee12e0310228', 'request_id': 'req-363e2362-878e-474a-86b7-c39f08623cb8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:51.164703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:51.172247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1e7e8df475427f8f62ee12e0310228', 'request_id': 'req-363e2362-878e-474a-86b7-c39f08623cb8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:51.188060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] The token cache is being invalidate because project 9c1e7e8df475427f8f62ee12e0310228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:51.188476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:51.189189 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-363e2362-878e-474a-86b7-c39f08623cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:51.191499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 990/1989] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:51 2022] DELETE /identity/v3/projects/9c1e7e8df475427f8f62ee12e0310228 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:52.182747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:52.184151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:52.197257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f43590-06b5-4d64-adcb-3c52be8766ad service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:52.255424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:52.256057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:52.256337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:52.256609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] PATH_INFO: `/v3/users/c125b360114445ec936dc7bb35cf4dfe` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:52.257844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c125b360114445ec936dc7bb35cf4dfe)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:52.259773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:52.306004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c125b360114445ec936dc7bb35cf4dfe'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:52.313431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c125b360114445ec936dc7bb35cf4dfe'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:52.314024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c125b360114445ec936dc7bb35cf4dfe'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:52.314670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c125b360114445ec936dc7bb35cf4dfe'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:52.324994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:52.329555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c125b360114445ec936dc7bb35cf4dfe'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:52.347401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1000/1990] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:29:52 2022] DELETE /identity/v3/users/c125b360114445ec936dc7bb35cf4dfe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:52.351574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced08a0-8865-48ab-b935-b911528703a1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:52.352053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced08a0-8865-48ab-b935-b911528703a1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:52.352135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced08a0-8865-48ab-b935-b911528703a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:52.374348 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-9ced08a0-8865-48ab-b935-b911528703a1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:52.375656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9ced08a0-8865-48ab-b935-b911528703a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:52.448049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 991/1991] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:52.468145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:52.469606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:52.535357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534bb8d-c462-4877-bff3-e8ef419adb54 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:52.539849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d350e4f-4733-428f-bd7c-d544035ca4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:52.540478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350e4f-4733-428f-bd7c-d544035ca4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:52.540754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350e4f-4733-428f-bd7c-d544035ca4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:52.541049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350e4f-4733-428f-bd7c-d544035ca4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:52.551670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d350e4f-4733-428f-bd7c-d544035ca4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:52.553087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d350e4f-4733-428f-bd7c-d544035ca4a1 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:52.562544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1001/1992] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:29:52.836478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced08a0-8865-48ab-b935-b911528703a1 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:52.837959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9ced08a0-8865-48ab-b935-b911528703a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:52.868809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced08a0-8865-48ab-b935-b911528703a1 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:52.883107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:52.884122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:52.884603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:52.884993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] PATH_INFO: `/v3/projects/62d0bdd8084b4309a1bafc762bf0fb4f` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:52.886823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d0bdd8084b4309a1bafc762bf0fb4f)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:52.889358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:52.948990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d0bdd8084b4309a1bafc762bf0fb4f', 'request_id': 'req-1a51e521-9305-4586-8937-7cfe269b9dea'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:52.955281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d0bdd8084b4309a1bafc762bf0fb4f', 'request_id': 'req-1a51e521-9305-4586-8937-7cfe269b9dea'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:52.966335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d0bdd8084b4309a1bafc762bf0fb4f', 'request_id': 'req-1a51e521-9305-4586-8937-7cfe269b9dea'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:53.000634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] The token cache is being invalidate because project 62d0bdd8084b4309a1bafc762bf0fb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:29:53.001070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:53.001799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a51e521-9305-4586-8937-7cfe269b9dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:29:53.004254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 992/1993] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:29:52 2022] DELETE /identity/v3/projects/62d0bdd8084b4309a1bafc762bf0fb4f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:29:53.009021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f258-e7d9-43a4-af45-360dc6d52fc4 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.009412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f258-e7d9-43a4-af45-360dc6d52fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.010307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f258-e7d9-43a4-af45-360dc6d52fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.031475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d691f258-e7d9-43a4-af45-360dc6d52fc4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:53.032751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d691f258-e7d9-43a4-af45-360dc6d52fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:53.102341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1002/1994] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:53.110091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8612c-eb08-455d-8578-e99d909e252e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.110446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8612c-eb08-455d-8578-e99d909e252e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.110793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8612c-eb08-455d-8578-e99d909e252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.140386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3df8612c-eb08-455d-8578-e99d909e252e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:53.141617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3df8612c-eb08-455d-8578-e99d909e252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:53.153204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 993/1995] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:29:53.157545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691f258-e7d9-43a4-af45-360dc6d52fc4 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:53.172396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691f258-e7d9-43a4-af45-360dc6d52fc4 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:53.179139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:53.180035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.180668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.181199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.182108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:29:53.182775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:53.185400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:53.201158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1003/1996] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:29:53.205298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8612c-eb08-455d-8578-e99d909e252e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:53.215313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8612c-eb08-455d-8578-e99d909e252e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:53.220296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1895b3-a018-4fb2-9d0c-6c893f1aaf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:53.221219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1895b3-a018-4fb2-9d0c-6c893f1aaf3c admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.221691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1895b3-a018-4fb2-9d0c-6c893f1aaf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.222218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1895b3-a018-4fb2-9d0c-6c893f1aaf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.223241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1895b3-a018-4fb2-9d0c-6c893f1aaf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:53.225486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1895b3-a018-4fb2-9d0c-6c893f1aaf3c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:53.259973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 994/1997] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:29:53 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:29:53.264335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:53.276573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af847a2-dead-41b8-94a3-04c66fe2ed64 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:53.354568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4374dc-feeb-4eac-9afe-85066daa1b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:53.355010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4374dc-feeb-4eac-9afe-85066daa1b54 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.355287 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4374dc-feeb-4eac-9afe-85066daa1b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.355556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4374dc-feeb-4eac-9afe-85066daa1b54 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.356180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4374dc-feeb-4eac-9afe-85066daa1b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:53.358497 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4374dc-feeb-4eac-9afe-85066daa1b54 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:53.385927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1004/1998] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:29:53 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:29:53.389681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1895b3-a018-4fb2-9d0c-6c893f1aaf3c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:53.401746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1895b3-a018-4fb2-9d0c-6c893f1aaf3c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:53.410884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea456e-205a-40d2-b3e0-038f7e6bc5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:53.411496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea456e-205a-40d2-b3e0-038f7e6bc5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.411777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea456e-205a-40d2-b3e0-038f7e6bc5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.412051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea456e-205a-40d2-b3e0-038f7e6bc5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.412693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea456e-205a-40d2-b3e0-038f7e6bc5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:53.414416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea456e-205a-40d2-b3e0-038f7e6bc5e3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:53.425760 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 995/1999] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:53.429778 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4374dc-feeb-4eac-9afe-85066daa1b54 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:53.436386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:53.442269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4374dc-feeb-4eac-9afe-85066daa1b54 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:53.450813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadabed1-67c0-4076-b718-528f00c5fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:53.451470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabed1-67c0-4076-b718-528f00c5fd4f admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.451752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabed1-67c0-4076-b718-528f00c5fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.452204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabed1-67c0-4076-b718-528f00c5fd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.453217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadabed1-67c0-4076-b718-528f00c5fd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:53.455519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadabed1-67c0-4076-b718-528f00c5fd4f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:53.468174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1005/2000] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:29:53.472850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea456e-205a-40d2-b3e0-038f7e6bc5e3 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:53.484542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea456e-205a-40d2-b3e0-038f7e6bc5e3 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:53.489858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:53.490626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.490991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.491337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] PATH_INFO: `/v3/projects/9ce249f9ca1247408e7cde2e4bdc58bb/users/5379e4bd87f34fb2b8798c2ccff7c2f0/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.510011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce249f9ca1247408e7cde2e4bdc58bb, user_id=5379e4bd87f34fb2b8798c2ccff7c2f0, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:53.514007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:53.538150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 996/2001] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:29:53 2022] PUT /identity/v3/projects/9ce249f9ca1247408e7cde2e4bdc58bb/users/5379e4bd87f34fb2b8798c2ccff7c2f0/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:29:53.543643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3fbb-3648-449d-9881-9ef61b81a4d1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.543938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3fbb-3648-449d-9881-9ef61b81a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.544214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3fbb-3648-449d-9881-9ef61b81a4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.572776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-113f3fbb-3648-449d-9881-9ef61b81a4d1 None None] MFA Rules not processed for user `5379e4bd87f34fb2b8798c2ccff7c2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:29:53.574564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-113f3fbb-3648-449d-9881-9ef61b81a4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:53.651151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1006/2002] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:29:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:29:53.664273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:29:53.666457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:29:53.681170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:29:53.750960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269de07e-7e52-4ae5-a87f-b3e7e2af2595 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:29:53.754673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453dddd-4642-4718-b0d2-2edbbbefaeab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:29:53.755346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453dddd-4642-4718-b0d2-2edbbbefaeab service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:29:53.755713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453dddd-4642-4718-b0d2-2edbbbefaeab service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:29:53.756049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453dddd-4642-4718-b0d2-2edbbbefaeab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:29:53.764301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453dddd-4642-4718-b0d2-2edbbbefaeab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:29:53.765738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453dddd-4642-4718-b0d2-2edbbbefaeab service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:29:53.775578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 997/2003] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:29:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:02.476077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a832ba-de84-4950-9883-787d0c0d6a0c None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:02.476662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a832ba-de84-4950-9883-787d0c0d6a0c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:02.476662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a832ba-de84-4950-9883-787d0c0d6a0c None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:02.479015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1007/2004] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:30:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:30:02.494587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595aba-5826-4cba-b1f2-565f597fd412 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:02.495193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595aba-5826-4cba-b1f2-565f597fd412 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:02.495385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595aba-5826-4cba-b1f2-565f597fd412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:02.521453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-21595aba-5826-4cba-b1f2-565f597fd412 None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:02.521453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-21595aba-5826-4cba-b1f2-565f597fd412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:02.524503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a832ba-de84-4950-9883-787d0c0d6a0c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:02.540753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-97a832ba-de84-4950-9883-787d0c0d6a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:02.597174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 998/2005] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:30:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:02.609374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21595aba-5826-4cba-b1f2-565f597fd412 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:02.612296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-21595aba-5826-4cba-b1f2-565f597fd412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:02.627994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21595aba-5826-4cba-b1f2-565f597fd412 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:02.633227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef677cb-4ae8-4818-8811-8241cf6cf480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:02.633935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef677cb-4ae8-4818-8811-8241cf6cf480 service placement] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:02.634347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef677cb-4ae8-4818-8811-8241cf6cf480 service placement] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:02.634724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef677cb-4ae8-4818-8811-8241cf6cf480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:02.640709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a832ba-de84-4950-9883-787d0c0d6a0c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:02.644860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef677cb-4ae8-4818-8811-8241cf6cf480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:02.646479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef677cb-4ae8-4818-8811-8241cf6cf480 service placement] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:02.647385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:02.648087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:02.648446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:02.648789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] PATH_INFO: `/v3/users/61fca635a71c4d73af5225a428bfabdd` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:02.650419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fca635a71c4d73af5225a428bfabdd)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:02.653234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:02.659161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 999/2006] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:30:02.711519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fca635a71c4d73af5225a428bfabdd'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:02.723924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fca635a71c4d73af5225a428bfabdd'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:02.724683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fca635a71c4d73af5225a428bfabdd'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:02.725367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fca635a71c4d73af5225a428bfabdd'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:02.738359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-769be893-979b-43e5-b13f-38dcd2e48e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fca635a71c4d73af5225a428bfabdd'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:02.752221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1008/2007] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:02 2022] DELETE /identity/v3/users/61fca635a71c4d73af5225a428bfabdd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:02.947724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef677cb-4ae8-4818-8811-8241cf6cf480 service placement] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:02.962293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef677cb-4ae8-4818-8811-8241cf6cf480 service placement] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:03.023141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:03.023846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.024124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.024393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] PATH_INFO: `/v3/projects/efbc580e28f54efea79658337149d294` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.025701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbc580e28f54efea79658337149d294)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:03.027939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:03.066679 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:03.076581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbc580e28f54efea79658337149d294', 'request_id': 'req-dc32203a-f132-4aca-b98f-e0c5ed68ee10'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:03.082678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbc580e28f54efea79658337149d294', 'request_id': 'req-dc32203a-f132-4aca-b98f-e0c5ed68ee10'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:03.089697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbc580e28f54efea79658337149d294', 'request_id': 'req-dc32203a-f132-4aca-b98f-e0c5ed68ee10'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:03.103551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] The token cache is being invalidate because project efbc580e28f54efea79658337149d294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:03.104072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:03.105345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc32203a-f132-4aca-b98f-e0c5ed68ee10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:03.109896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1000/2008] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:02 2022] DELETE /identity/v3/projects/efbc580e28f54efea79658337149d294 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:03.113119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558edd-26f2-4149-a175-030b9b8de48b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.113416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558edd-26f2-4149-a175-030b9b8de48b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.113693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558edd-26f2-4149-a175-030b9b8de48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.121368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:03.135107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f0558edd-26f2-4149-a175-030b9b8de48b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:03.136857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f0558edd-26f2-4149-a175-030b9b8de48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:03.213133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1009/2009] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:03.214644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1369c-de50-4540-8ccc-a0f94f5e62de None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.214958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1369c-de50-4540-8ccc-a0f94f5e62de None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.215233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1369c-de50-4540-8ccc-a0f94f5e62de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.236212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f9a1369c-de50-4540-8ccc-a0f94f5e62de None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:03.237610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f9a1369c-de50-4540-8ccc-a0f94f5e62de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:03.247462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1001/2010] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:03.252282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558edd-26f2-4149-a175-030b9b8de48b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:03.262155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558edd-26f2-4149-a175-030b9b8de48b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:03.266807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:03.267994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.268516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.268814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.269427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:03.269727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:03.271325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:03.282813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1010/2011] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:30:03.287043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1369c-de50-4540-8ccc-a0f94f5e62de None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:03.296498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1369c-de50-4540-8ccc-a0f94f5e62de None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:03.301377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2abc-217c-4e21-8b51-53576c811c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:03.301975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2abc-217c-4e21-8b51-53576c811c1f admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.302291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2abc-217c-4e21-8b51-53576c811c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.302562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2abc-217c-4e21-8b51-53576c811c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.303183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2abc-217c-4e21-8b51-53576c811c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:03.305071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2abc-217c-4e21-8b51-53576c811c1f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:03.333064 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1002/2012] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:03 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:03.337298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:03.347187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739b7e-89ad-47e9-bc03-f325de93c8dd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:03.405543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d4ea3-773c-41f2-8b18-429e68a2f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:03.406188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4ea3-773c-41f2-8b18-429e68a2f639 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.406780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4ea3-773c-41f2-8b18-429e68a2f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.407065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4ea3-773c-41f2-8b18-429e68a2f639 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.407753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d4ea3-773c-41f2-8b18-429e68a2f639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:03.409736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d4ea3-773c-41f2-8b18-429e68a2f639 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:03.430819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1011/2013] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:03 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:03.435539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2abc-217c-4e21-8b51-53576c811c1f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:03.451104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2abc-217c-4e21-8b51-53576c811c1f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:03.458040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd164a-384b-4e16-89cc-6ee0ca6e6ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:03.458781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd164a-384b-4e16-89cc-6ee0ca6e6ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.458980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd164a-384b-4e16-89cc-6ee0ca6e6ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.459233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd164a-384b-4e16-89cc-6ee0ca6e6ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.459891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd164a-384b-4e16-89cc-6ee0ca6e6ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:03.461517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd164a-384b-4e16-89cc-6ee0ca6e6ad5 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:03.473597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1003/2014] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:03.477689 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d4ea3-773c-41f2-8b18-429e68a2f639 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:03.488797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d4ea3-773c-41f2-8b18-429e68a2f639 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:03.493594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379c72f-b271-4f61-bf2e-88d235911ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:03.494226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379c72f-b271-4f61-bf2e-88d235911ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.494509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379c72f-b271-4f61-bf2e-88d235911ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.494782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379c72f-b271-4f61-bf2e-88d235911ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.495422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379c72f-b271-4f61-bf2e-88d235911ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:03.497008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379c72f-b271-4f61-bf2e-88d235911ff8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:03.511966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1012/2015] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:03.516004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd164a-384b-4e16-89cc-6ee0ca6e6ad5 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:03.526616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd164a-384b-4e16-89cc-6ee0ca6e6ad5 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:03.533156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:03.533868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.534203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.534484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] PATH_INFO: `/v3/projects/e0386444ece84131b636749f494a7329/users/4358a13a6e8d4795b28c4eb2d71ab4a6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.551180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0386444ece84131b636749f494a7329, user_id=4358a13a6e8d4795b28c4eb2d71ab4a6, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:03.554201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:03.567166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1004/2016] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:03 2022] PUT /identity/v3/projects/e0386444ece84131b636749f494a7329/users/4358a13a6e8d4795b28c4eb2d71ab4a6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:03.572302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831997d-4af6-4ede-8d55-4abdad8a1b81 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.572595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831997d-4af6-4ede-8d55-4abdad8a1b81 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.572870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831997d-4af6-4ede-8d55-4abdad8a1b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.591839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6831997d-4af6-4ede-8d55-4abdad8a1b81 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:03.593038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6831997d-4af6-4ede-8d55-4abdad8a1b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:03.655540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1013/2017] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:03.666467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:03.668523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:03.726349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791644d-3b99-47e5-82e0-bb0ce073d3e0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:03.729977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457310b-8fe2-4a95-816f-b2dbb027245e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:03.730606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457310b-8fe2-4a95-816f-b2dbb027245e service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:03.730887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457310b-8fe2-4a95-816f-b2dbb027245e service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:03.731161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457310b-8fe2-4a95-816f-b2dbb027245e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:03.744545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457310b-8fe2-4a95-816f-b2dbb027245e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:03.746103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457310b-8fe2-4a95-816f-b2dbb027245e service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:03.756346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1005/2018] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:04.279081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831997d-4af6-4ede-8d55-4abdad8a1b81 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.280480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6831997d-4af6-4ede-8d55-4abdad8a1b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:04.293392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831997d-4af6-4ede-8d55-4abdad8a1b81 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:04.298638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:04.299270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.299549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.299818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] PATH_INFO: `/v3/users/5379e4bd87f34fb2b8798c2ccff7c2f0` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.300942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5379e4bd87f34fb2b8798c2ccff7c2f0)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:04.302888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:04.305323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:04.353539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5379e4bd87f34fb2b8798c2ccff7c2f0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:04.363685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5379e4bd87f34fb2b8798c2ccff7c2f0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:04.364381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5379e4bd87f34fb2b8798c2ccff7c2f0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:04.365050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5379e4bd87f34fb2b8798c2ccff7c2f0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:04.378708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-375bb1ef-d2e1-4235-80b8-e7bd92edcc94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5379e4bd87f34fb2b8798c2ccff7c2f0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:04.395276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1014/2019] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:04 2022] DELETE /identity/v3/users/5379e4bd87f34fb2b8798c2ccff7c2f0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:04.400020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757e542-56b6-4b6c-a9d7-7f40fc951006 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.401556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757e542-56b6-4b6c-a9d7-7f40fc951006 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.401556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757e542-56b6-4b6c-a9d7-7f40fc951006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.424734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-9757e542-56b6-4b6c-a9d7-7f40fc951006 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:04.424906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd724d-c6d3-4efe-a5d6-a22fea68613b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.425072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd724d-c6d3-4efe-a5d6-a22fea68613b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.425352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd724d-c6d3-4efe-a5d6-a22fea68613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.425939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9757e542-56b6-4b6c-a9d7-7f40fc951006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:04.457319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c6cd724d-c6d3-4efe-a5d6-a22fea68613b None None] MFA Rules not processed for user `4358a13a6e8d4795b28c4eb2d71ab4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:04.458843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c6cd724d-c6d3-4efe-a5d6-a22fea68613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:04.504376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1006/2020] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:04.513066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757e542-56b6-4b6c-a9d7-7f40fc951006 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.514437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9757e542-56b6-4b6c-a9d7-7f40fc951006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:04.520559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:04.537774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1015/2021] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:04.542041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd724d-c6d3-4efe-a5d6-a22fea68613b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.544037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c6cd724d-c6d3-4efe-a5d6-a22fea68613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:04.559956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd724d-c6d3-4efe-a5d6-a22fea68613b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:04.566570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966b9d5-ec90-4dda-8462-db404c5cf1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:04.567207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966b9d5-ec90-4dda-8462-db404c5cf1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.567492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966b9d5-ec90-4dda-8462-db404c5cf1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.567766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966b9d5-ec90-4dda-8462-db404c5cf1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.568407 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966b9d5-ec90-4dda-8462-db404c5cf1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:04.570452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966b9d5-ec90-4dda-8462-db404c5cf1e0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:04.590004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757e542-56b6-4b6c-a9d7-7f40fc951006 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:04.593991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d28b-a22b-482d-bfcb-5e6cd4dc2281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:04.594641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d28b-a22b-482d-bfcb-5e6cd4dc2281 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.594967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d28b-a22b-482d-bfcb-5e6cd4dc2281 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.595447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d28b-a22b-482d-bfcb-5e6cd4dc2281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.608052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1016/2022] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:04 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:04.608871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74d28b-a22b-482d-bfcb-5e6cd4dc2281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:04.610359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74d28b-a22b-482d-bfcb-5e6cd4dc2281 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:04.615119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966b9d5-ec90-4dda-8462-db404c5cf1e0 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.621164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1007/2023] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:30:04.671485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:04.691212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966b9d5-ec90-4dda-8462-db404c5cf1e0 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:04.697985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d3c41-b581-4f07-a870-a41f5dec18cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:04.698786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d3c41-b581-4f07-a870-a41f5dec18cd admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.699295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d3c41-b581-4f07-a870-a41f5dec18cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.700177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d3c41-b581-4f07-a870-a41f5dec18cd admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.700577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d3c41-b581-4f07-a870-a41f5dec18cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:04.702642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d3c41-b581-4f07-a870-a41f5dec18cd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:04.730997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1017/2024] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:04 2022] POST /identity/v3/users => generated 308 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:04.732660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d28b-a22b-482d-bfcb-5e6cd4dc2281 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.744919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d28b-a22b-482d-bfcb-5e6cd4dc2281 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:04.750576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302665fb-f706-4dbd-8664-b1b7a20149ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:04.751369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302665fb-f706-4dbd-8664-b1b7a20149ac admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.752355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302665fb-f706-4dbd-8664-b1b7a20149ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.753224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302665fb-f706-4dbd-8664-b1b7a20149ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.769152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302665fb-f706-4dbd-8664-b1b7a20149ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:04.771095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302665fb-f706-4dbd-8664-b1b7a20149ac admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:04.799192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1008/2025] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:30:04.800685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d3c41-b581-4f07-a870-a41f5dec18cd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.813329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d3c41-b581-4f07-a870-a41f5dec18cd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:04.820170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:04.820916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.821231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.821496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] PATH_INFO: `/v3/projects/4086690076a244a49d9e1ddd79187160/users/97a3abc6c1c7432a80ee556ad13614dc/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.840991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4086690076a244a49d9e1ddd79187160, user_id=97a3abc6c1c7432a80ee556ad13614dc, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:04.843697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:04.868640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1018/2026] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:04 2022] PUT /identity/v3/projects/4086690076a244a49d9e1ddd79187160/users/97a3abc6c1c7432a80ee556ad13614dc/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:04.872662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302665fb-f706-4dbd-8664-b1b7a20149ac admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.884021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302665fb-f706-4dbd-8664-b1b7a20149ac admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:04.947967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.949969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:04.959407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c37533-809e-4fb0-9262-d3bc1ab4bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:04.960250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37533-809e-4fb0-9262-d3bc1ab4bfda admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:04.960806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37533-809e-4fb0-9262-d3bc1ab4bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:04.961314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37533-809e-4fb0-9262-d3bc1ab4bfda admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:04.962025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c37533-809e-4fb0-9262-d3bc1ab4bfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:04.963546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c37533-809e-4fb0-9262-d3bc1ab4bfda admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:04.976565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1009/2027] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:04.980710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c37533-809e-4fb0-9262-d3bc1ab4bfda admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:04.993939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c37533-809e-4fb0-9262-d3bc1ab4bfda admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:04.999079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb567d-6a02-4408-bcc9-ba35b3c5ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:04.999746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb567d-6a02-4408-bcc9-ba35b3c5ab0c admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.000094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb567d-6a02-4408-bcc9-ba35b3c5ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.000384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb567d-6a02-4408-bcc9-ba35b3c5ab0c admin admin] PATH_INFO: `/v3/projects/4086690076a244a49d9e1ddd79187160/users/97a3abc6c1c7432a80ee556ad13614dc/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.003160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb567d-6a02-4408-bcc9-ba35b3c5ab0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4086690076a244a49d9e1ddd79187160, user_id=97a3abc6c1c7432a80ee556ad13614dc, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.005817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb567d-6a02-4408-bcc9-ba35b3c5ab0c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.017737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1010/2028] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:04 2022] PUT /identity/v3/projects/4086690076a244a49d9e1ddd79187160/users/97a3abc6c1c7432a80ee556ad13614dc/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:05.032305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f227e-4199-4393-a67e-9789d0b019ec admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:05.090709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:05.091356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.091618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.091888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] PATH_INFO: `/v3/projects/9ce249f9ca1247408e7cde2e4bdc58bb` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.093332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce249f9ca1247408e7cde2e4bdc58bb)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.095377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.149000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce249f9ca1247408e7cde2e4bdc58bb', 'request_id': 'req-33034cf5-ce55-496c-bd61-f09cba7808ef'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:05.154865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce249f9ca1247408e7cde2e4bdc58bb', 'request_id': 'req-33034cf5-ce55-496c-bd61-f09cba7808ef'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:05.162272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce249f9ca1247408e7cde2e4bdc58bb', 'request_id': 'req-33034cf5-ce55-496c-bd61-f09cba7808ef'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:05.165064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:05.181053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] The token cache is being invalidate because project 9ce249f9ca1247408e7cde2e4bdc58bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:05.181280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:05.182123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-33034cf5-ce55-496c-bd61-f09cba7808ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:05.186958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1019/2029] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:04 2022] DELETE /identity/v3/projects/9ce249f9ca1247408e7cde2e4bdc58bb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:05.188795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be38504-5338-45b3-87bb-288f2e35f73e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.189703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be38504-5338-45b3-87bb-288f2e35f73e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.189965 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be38504-5338-45b3-87bb-288f2e35f73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.217137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-0be38504-5338-45b3-87bb-288f2e35f73e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:05.218661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0be38504-5338-45b3-87bb-288f2e35f73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:05.286480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1011/2030] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:05.297601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323b7c-77b2-4eaa-8840-70b6959c3683 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.297888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323b7c-77b2-4eaa-8840-70b6959c3683 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.298243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323b7c-77b2-4eaa-8840-70b6959c3683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.322239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ce323b7c-77b2-4eaa-8840-70b6959c3683 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:05.323496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ce323b7c-77b2-4eaa-8840-70b6959c3683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:05.333774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1020/2031] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:05.337646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be38504-5338-45b3-87bb-288f2e35f73e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:05.348540 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be38504-5338-45b3-87bb-288f2e35f73e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:05.354610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:05.355425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.355605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.356018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.356741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:05.357122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.358936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.373638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1012/2032] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:30:05.379920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323b7c-77b2-4eaa-8840-70b6959c3683 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:05.390944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323b7c-77b2-4eaa-8840-70b6959c3683 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:05.396446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33024b21-20a8-415d-86db-4cc2bc597be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:05.397849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33024b21-20a8-415d-86db-4cc2bc597be7 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.398579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33024b21-20a8-415d-86db-4cc2bc597be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.398579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33024b21-20a8-415d-86db-4cc2bc597be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.400088 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33024b21-20a8-415d-86db-4cc2bc597be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.402549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33024b21-20a8-415d-86db-4cc2bc597be7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.442335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1021/2033] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:05 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:05.445842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:05.452797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:05.471317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a935d-a4c0-4fea-8de6-902a1d403d49 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:05.543241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8b6bf-6107-4687-8676-ae2bee4bc51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:05.543881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8b6bf-6107-4687-8676-ae2bee4bc51e admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.544209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8b6bf-6107-4687-8676-ae2bee4bc51e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.544557 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8b6bf-6107-4687-8676-ae2bee4bc51e admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.545194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8b6bf-6107-4687-8676-ae2bee4bc51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.547296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8b6bf-6107-4687-8676-ae2bee4bc51e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.570448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1013/2034] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:05 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:05.574488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33024b21-20a8-415d-86db-4cc2bc597be7 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:05.585008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33024b21-20a8-415d-86db-4cc2bc597be7 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:05.589774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2425ce-6003-471a-bce4-581eb7a460d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:05.590695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2425ce-6003-471a-bce4-581eb7a460d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.590695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2425ce-6003-471a-bce4-581eb7a460d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.590937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2425ce-6003-471a-bce4-581eb7a460d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.591695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2425ce-6003-471a-bce4-581eb7a460d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.593268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2425ce-6003-471a-bce4-581eb7a460d3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.605076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1022/2035] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:05.609031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8b6bf-6107-4687-8676-ae2bee4bc51e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:05.620738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8b6bf-6107-4687-8676-ae2bee4bc51e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:05.625502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8d2ee-f3b8-4b5f-a281-653b4b9df1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:05.626137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8d2ee-f3b8-4b5f-a281-653b4b9df1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.626421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8d2ee-f3b8-4b5f-a281-653b4b9df1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.626728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8d2ee-f3b8-4b5f-a281-653b4b9df1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.627373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8d2ee-f3b8-4b5f-a281-653b4b9df1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.628969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8d2ee-f3b8-4b5f-a281-653b4b9df1c4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.639982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1014/2036] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:05.645145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2425ce-6003-471a-bce4-581eb7a460d3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:05.656168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2425ce-6003-471a-bce4-581eb7a460d3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:05.661705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd1d15-695f-4644-8140-1bcf22d9ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:05.662394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd1d15-695f-4644-8140-1bcf22d9ac53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.662670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd1d15-695f-4644-8140-1bcf22d9ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.662939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd1d15-695f-4644-8140-1bcf22d9ac53 admin admin] PATH_INFO: `/v3/projects/f17974ccd44a4e14ae9073f765864b9d/users/3a1b37f5d7c44586b3e4beb32959857e/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.679186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd1d15-695f-4644-8140-1bcf22d9ac53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17974ccd44a4e14ae9073f765864b9d, user_id=3a1b37f5d7c44586b3e4beb32959857e, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.682104 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd1d15-695f-4644-8140-1bcf22d9ac53 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.704150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1023/2037] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:05 2022] PUT /identity/v3/projects/f17974ccd44a4e14ae9073f765864b9d/users/3a1b37f5d7c44586b3e4beb32959857e/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:05.716278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d2f9-c0f9-4cf4-aa4a-efe452d3ec7e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.716570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d2f9-c0f9-4cf4-aa4a-efe452d3ec7e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.716905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d2f9-c0f9-4cf4-aa4a-efe452d3ec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.732563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b325ef-94f7-4e09-9bab-57de2a32c635 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.732852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b325ef-94f7-4e09-9bab-57de2a32c635 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.733124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b325ef-94f7-4e09-9bab-57de2a32c635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.754980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-dca2d2f9-c0f9-4cf4-aa4a-efe452d3ec7e None None] MFA Rules not processed for user `3a1b37f5d7c44586b3e4beb32959857e`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:05.756505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dca2d2f9-c0f9-4cf4-aa4a-efe452d3ec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:05.766652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-47b325ef-94f7-4e09-9bab-57de2a32c635 None None] MFA Rules not processed for user `97a3abc6c1c7432a80ee556ad13614dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:05.768844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-47b325ef-94f7-4e09-9bab-57de2a32c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:05.859612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1024/2038] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:05 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:05.875403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1015/2039] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:05.882992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b325ef-94f7-4e09-9bab-57de2a32c635 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:05.884737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-47b325ef-94f7-4e09-9bab-57de2a32c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:05.945390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b325ef-94f7-4e09-9bab-57de2a32c635 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:05.949086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be559413-80a4-4a49-8f58-bf320a821f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:05.949693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559413-80a4-4a49-8f58-bf320a821f3d service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:05.949980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559413-80a4-4a49-8f58-bf320a821f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:05.950315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559413-80a4-4a49-8f58-bf320a821f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:05.959203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be559413-80a4-4a49-8f58-bf320a821f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:05.960631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be559413-80a4-4a49-8f58-bf320a821f3d service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:05.970055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1025/2040] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:07.189196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c230a3-f44f-4f3c-9f21-026eb850cf22 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:07.189684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c230a3-f44f-4f3c-9f21-026eb850cf22 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:07.189776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c230a3-f44f-4f3c-9f21-026eb850cf22 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:07.191111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1016/2041] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:30:07.217776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642a88-5649-4b0c-8fba-1d27ba92870c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:07.218319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642a88-5649-4b0c-8fba-1d27ba92870c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:07.218397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642a88-5649-4b0c-8fba-1d27ba92870c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:07.238709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-95642a88-5649-4b0c-8fba-1d27ba92870c None None] MFA Rules not processed for user `a35c6a59728d4b3c9fad8599c88f779e`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:07.239918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-95642a88-5649-4b0c-8fba-1d27ba92870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:07.250954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:07.302082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c230a3-f44f-4f3c-9f21-026eb850cf22 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:07.303907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-58c230a3-f44f-4f3c-9f21-026eb850cf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:07.338563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1026/2042] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:07.354458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95642a88-5649-4b0c-8fba-1d27ba92870c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:07.356536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-95642a88-5649-4b0c-8fba-1d27ba92870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:07.373981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95642a88-5649-4b0c-8fba-1d27ba92870c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:07.391204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706070-078d-42b9-a409-36670edf9540 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:07.391820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706070-078d-42b9-a409-36670edf9540 service placement] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:07.392602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706070-078d-42b9-a409-36670edf9540 service placement] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:07.392883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706070-078d-42b9-a409-36670edf9540 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:07.402470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9706070-078d-42b9-a409-36670edf9540 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:07.403174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c230a3-f44f-4f3c-9f21-026eb850cf22 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:07.404126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9706070-078d-42b9-a409-36670edf9540 service placement] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:07.410285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:07.411001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:07.411493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:07.411864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] PATH_INFO: `/v3/users/4358a13a6e8d4795b28c4eb2d71ab4a6` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:07.413103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4358a13a6e8d4795b28c4eb2d71ab4a6)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:07.415204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:07.415646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1027/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:07.441146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:07.482055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4358a13a6e8d4795b28c4eb2d71ab4a6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.489806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4358a13a6e8d4795b28c4eb2d71ab4a6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.490470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4358a13a6e8d4795b28c4eb2d71ab4a6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.498622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4358a13a6e8d4795b28c4eb2d71ab4a6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.512357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4358a13a6e8d4795b28c4eb2d71ab4a6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.520212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1017/2044] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:07 2022] DELETE /identity/v3/users/4358a13a6e8d4795b28c4eb2d71ab4a6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:07.697141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706070-078d-42b9-a409-36670edf9540 service placement] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:07.714448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706070-078d-42b9-a409-36670edf9540 service placement] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:07.770413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:07.771034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:07.771312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:07.771582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] PATH_INFO: `/v3/projects/e0386444ece84131b636749f494a7329` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:07.772676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0386444ece84131b636749f494a7329)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:07.774600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:07.819219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0386444ece84131b636749f494a7329', 'request_id': 'req-9c392c95-99aa-43fd-9c27-32095891b325'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.824977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0386444ece84131b636749f494a7329', 'request_id': 'req-9c392c95-99aa-43fd-9c27-32095891b325'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.832016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0386444ece84131b636749f494a7329', 'request_id': 'req-9c392c95-99aa-43fd-9c27-32095891b325'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.845386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] The token cache is being invalidate because project e0386444ece84131b636749f494a7329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:07.845666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.846340 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:07.847864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1028/2045] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:07 2022] DELETE /identity/v3/projects/e0386444ece84131b636749f494a7329 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:07.859287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:07.860891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:07.875069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e656b-8895-4492-a98b-ff671fd63eb8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:07.938751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:07.940021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:07.940707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:07.940707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] PATH_INFO: `/v3/users/97a3abc6c1c7432a80ee556ad13614dc` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:07.941711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a3abc6c1c7432a80ee556ad13614dc)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:07.943697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:07.997609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a3abc6c1c7432a80ee556ad13614dc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.007286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a3abc6c1c7432a80ee556ad13614dc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.008007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a3abc6c1c7432a80ee556ad13614dc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.015695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a3abc6c1c7432a80ee556ad13614dc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.029487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-c8bb4484-ed8f-4264-b5d3-1db727c8030c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a3abc6c1c7432a80ee556ad13614dc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.035863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1018/2046] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:07 2022] DELETE /identity/v3/users/97a3abc6c1c7432a80ee556ad13614dc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:08.216788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:08.218341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:08.231563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c392c95-99aa-43fd-9c27-32095891b325 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:08.262182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:08.296710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:08.297344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.297627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.297903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] PATH_INFO: `/v3/projects/4086690076a244a49d9e1ddd79187160` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.299665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4086690076a244a49d9e1ddd79187160)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:08.301670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:08.346417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4086690076a244a49d9e1ddd79187160', 'request_id': 'req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.352052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4086690076a244a49d9e1ddd79187160', 'request_id': 'req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.358277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4086690076a244a49d9e1ddd79187160', 'request_id': 'req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.371143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] The token cache is being invalidate because project 4086690076a244a49d9e1ddd79187160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:08.371432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.372052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-f3c23df7-455f-4c2f-b88f-fafb12cdb2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:08.373524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1029/2047] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:08 2022] DELETE /identity/v3/projects/4086690076a244a49d9e1ddd79187160 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:08.378532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2cdf-c899-411e-a341-db54cd50be1f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.378985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2cdf-c899-411e-a341-db54cd50be1f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.379517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2cdf-c899-411e-a341-db54cd50be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.399208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-31ee2cdf-c899-411e-a341-db54cd50be1f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:08.400496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-31ee2cdf-c899-411e-a341-db54cd50be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:08.406789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:08.465224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1019/2048] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:08.474151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e955077-8aac-4ec7-ace1-50ea0994e3a0 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.474451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e955077-8aac-4ec7-ace1-50ea0994e3a0 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.474731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e955077-8aac-4ec7-ace1-50ea0994e3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.497572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-7e955077-8aac-4ec7-ace1-50ea0994e3a0 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:08.498909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7e955077-8aac-4ec7-ace1-50ea0994e3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:08.507172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1030/2049] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:08.511505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee2cdf-c899-411e-a341-db54cd50be1f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:08.521498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee2cdf-c899-411e-a341-db54cd50be1f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:08.526834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:08.527441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.527750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.528024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.528675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:08.528983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:08.530653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:08.542835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1020/2050] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:30:08.547228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e955077-8aac-4ec7-ace1-50ea0994e3a0 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:08.559423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e955077-8aac-4ec7-ace1-50ea0994e3a0 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:08.567070 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d5185-fc27-41ab-b449-54fcb2b6968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:08.567784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5185-fc27-41ab-b449-54fcb2b6968d admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.568164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5185-fc27-41ab-b449-54fcb2b6968d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.568676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5185-fc27-41ab-b449-54fcb2b6968d admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.569534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d5185-fc27-41ab-b449-54fcb2b6968d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:08.571714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d5185-fc27-41ab-b449-54fcb2b6968d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:08.599561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1031/2051] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:08 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:08.603876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:08.615339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505477ab-8729-4c41-b046-3914b3126829 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:08.674406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9620b1-c893-49e2-ac3e-ac48763b3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:08.675015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9620b1-c893-49e2-ac3e-ac48763b3168 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.675300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9620b1-c893-49e2-ac3e-ac48763b3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.675578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9620b1-c893-49e2-ac3e-ac48763b3168 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.676201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9620b1-c893-49e2-ac3e-ac48763b3168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:08.678371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9620b1-c893-49e2-ac3e-ac48763b3168 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:08.702407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1021/2052] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:08 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:08.707520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d5185-fc27-41ab-b449-54fcb2b6968d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:08.719017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d5185-fc27-41ab-b449-54fcb2b6968d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:08.725301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79536f-5629-4437-bb73-3a5d7ffaa5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:08.726219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79536f-5629-4437-bb73-3a5d7ffaa5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.726548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79536f-5629-4437-bb73-3a5d7ffaa5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.726965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79536f-5629-4437-bb73-3a5d7ffaa5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.727891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79536f-5629-4437-bb73-3a5d7ffaa5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:08.729528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79536f-5629-4437-bb73-3a5d7ffaa5b2 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:08.743741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1032/2053] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:08.746550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9620b1-c893-49e2-ac3e-ac48763b3168 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:08.765333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9620b1-c893-49e2-ac3e-ac48763b3168 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:08.772000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ee2b0-6821-46e9-8f88-aa1b5c06d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:08.772450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee2b0-6821-46e9-8f88-aa1b5c06d761 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.772733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee2b0-6821-46e9-8f88-aa1b5c06d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.773011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee2b0-6821-46e9-8f88-aa1b5c06d761 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.773662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ee2b0-6821-46e9-8f88-aa1b5c06d761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:08.775328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ee2b0-6821-46e9-8f88-aa1b5c06d761 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:08.786876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1022/2054] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:30:08.791363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79536f-5629-4437-bb73-3a5d7ffaa5b2 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:08.801681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79536f-5629-4437-bb73-3a5d7ffaa5b2 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:08.806290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5b2b7-a485-4bb1-b6e7-4608f0ea8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:08.806927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b2b7-a485-4bb1-b6e7-4608f0ea8547 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.807208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b2b7-a485-4bb1-b6e7-4608f0ea8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.807480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b2b7-a485-4bb1-b6e7-4608f0ea8547 admin admin] PATH_INFO: `/v3/projects/2643bc510ecb4efab577db9441a48a19/users/41053bcdd52d4332932b2bbaf4a8a76a/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.821843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5b2b7-a485-4bb1-b6e7-4608f0ea8547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2643bc510ecb4efab577db9441a48a19, user_id=41053bcdd52d4332932b2bbaf4a8a76a, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:08.824502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5b2b7-a485-4bb1-b6e7-4608f0ea8547 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:08.837479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1033/2055] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:08 2022] PUT /identity/v3/projects/2643bc510ecb4efab577db9441a48a19/users/41053bcdd52d4332932b2bbaf4a8a76a/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:08.848269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b120-358f-4df7-84a4-06492c846a2f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:08.848574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b120-358f-4df7-84a4-06492c846a2f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:08.848839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b120-358f-4df7-84a4-06492c846a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:08.875810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-73f2b120-358f-4df7-84a4-06492c846a2f None None] MFA Rules not processed for user `41053bcdd52d4332932b2bbaf4a8a76a`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:08.879810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-73f2b120-358f-4df7-84a4-06492c846a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:08.944746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1023/2056] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:08.949235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5b2b7-a485-4bb1-b6e7-4608f0ea8547 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:09.006728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:09.013335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5b2b7-a485-4bb1-b6e7-4608f0ea8547 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:09.019468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1b90e-5787-44e4-ab3d-9e040a7fbc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:09.020069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1b90e-5787-44e4-ab3d-9e040a7fbc6f admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:09.020348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1b90e-5787-44e4-ab3d-9e040a7fbc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:09.020622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1b90e-5787-44e4-ab3d-9e040a7fbc6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:09.021241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1b90e-5787-44e4-ab3d-9e040a7fbc6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:09.023186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1b90e-5787-44e4-ab3d-9e040a7fbc6f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:09.049413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1034/2057] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:08 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:09.055068 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b120-358f-4df7-84a4-06492c846a2f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:09.066664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b120-358f-4df7-84a4-06492c846a2f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:09.070392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:09.125445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02767272-4998-4665-ab3e-dccd1ae7e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:09.126051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02767272-4998-4665-ab3e-dccd1ae7e654 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:09.126860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02767272-4998-4665-ab3e-dccd1ae7e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:09.127126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02767272-4998-4665-ab3e-dccd1ae7e654 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:09.127755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02767272-4998-4665-ab3e-dccd1ae7e654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:09.129667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02767272-4998-4665-ab3e-dccd1ae7e654 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:09.159198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1024/2058] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:09 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:09.160678 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1b90e-5787-44e4-ab3d-9e040a7fbc6f admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:09.171041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1b90e-5787-44e4-ab3d-9e040a7fbc6f admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:09.175695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebef244-2609-4e74-a67b-e78fa6b29ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:09.176291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef244-2609-4e74-a67b-e78fa6b29ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:09.176571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef244-2609-4e74-a67b-e78fa6b29ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:09.176842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef244-2609-4e74-a67b-e78fa6b29ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:09.177471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebef244-2609-4e74-a67b-e78fa6b29ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:09.179066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebef244-2609-4e74-a67b-e78fa6b29ba9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:09.190181 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1035/2059] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:09.194485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02767272-4998-4665-ab3e-dccd1ae7e654 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:09.206007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02767272-4998-4665-ab3e-dccd1ae7e654 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:09.211193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b61ce-1018-44eb-9b51-5542e03f62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:09.211851 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b61ce-1018-44eb-9b51-5542e03f62ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:09.212132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b61ce-1018-44eb-9b51-5542e03f62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:09.212408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b61ce-1018-44eb-9b51-5542e03f62ea admin admin] PATH_INFO: `/v3/projects/52fd98479f0e49b48d02baf86e8a7bed/users/46df44657d1e4e3290a665944cfc9e12/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:09.227386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b61ce-1018-44eb-9b51-5542e03f62ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fd98479f0e49b48d02baf86e8a7bed, user_id=46df44657d1e4e3290a665944cfc9e12, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:09.230203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b61ce-1018-44eb-9b51-5542e03f62ea admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:09.245841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1025/2060] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:09 2022] PUT /identity/v3/projects/52fd98479f0e49b48d02baf86e8a7bed/users/46df44657d1e4e3290a665944cfc9e12/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:09.250005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebef244-2609-4e74-a67b-e78fa6b29ba9 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:09.261053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebef244-2609-4e74-a67b-e78fa6b29ba9 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:09.321732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fc83-6edc-4304-a5c5-0ca7bdffbc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:09.322365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fc83-6edc-4304-a5c5-0ca7bdffbc4e admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:09.322652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fc83-6edc-4304-a5c5-0ca7bdffbc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:09.322928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fc83-6edc-4304-a5c5-0ca7bdffbc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:09.323573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87fc83-6edc-4304-a5c5-0ca7bdffbc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:09.325180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87fc83-6edc-4304-a5c5-0ca7bdffbc4e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:09.340116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1036/2061] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:09.341266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b61ce-1018-44eb-9b51-5542e03f62ea admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:09.352338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b61ce-1018-44eb-9b51-5542e03f62ea admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:09.357120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:09.357775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:09.358131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:09.358372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] PATH_INFO: `/v3/projects/52fd98479f0e49b48d02baf86e8a7bed/users/46df44657d1e4e3290a665944cfc9e12/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:09.360641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fd98479f0e49b48d02baf86e8a7bed, user_id=46df44657d1e4e3290a665944cfc9e12, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:09.363393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:09.379790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1026/2062] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:09 2022] PUT /identity/v3/projects/52fd98479f0e49b48d02baf86e8a7bed/users/46df44657d1e4e3290a665944cfc9e12/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:09.394353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c7fa1-2b8e-489d-abd6-c83ae0ee0eb3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:09.394353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c7fa1-2b8e-489d-abd6-c83ae0ee0eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:09.394575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c7fa1-2b8e-489d-abd6-c83ae0ee0eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:09.430235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ea6c7fa1-2b8e-489d-abd6-c83ae0ee0eb3 None None] MFA Rules not processed for user `46df44657d1e4e3290a665944cfc9e12`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:09.432291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ea6c7fa1-2b8e-489d-abd6-c83ae0ee0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:09.507853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1037/2063] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:09.519873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:09.521585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:09.582595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cda6b-c24e-4040-b43e-c1f184421875 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:09.586667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:09.587572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:09.588068 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:09.588551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:09.648064 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:09.649516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:09.658715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1027/2064] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:11.068834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c7fa1-2b8e-489d-abd6-c83ae0ee0eb3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:11.079634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c7fa1-2b8e-489d-abd6-c83ae0ee0eb3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:11.083234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a7f0-9b85-47d3-a64e-e2d3e9a13d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:11.083844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a7f0-9b85-47d3-a64e-e2d3e9a13d84 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:11.084108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a7f0-9b85-47d3-a64e-e2d3e9a13d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:11.084382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a7f0-9b85-47d3-a64e-e2d3e9a13d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:11.094892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58a7f0-9b85-47d3-a64e-e2d3e9a13d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:11.103636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58a7f0-9b85-47d3-a64e-e2d3e9a13d84 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:11.107808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1038/2065] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:14.449906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:14.451450 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:14.468076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:14.520777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30277d8-5f70-4a3d-a615-62c890ae0934 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:14.525206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:14.525827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:14.526200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:14.526495 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] PATH_INFO: `/v3/users/8cbc05dcdd7045de8bceeefee61b2857` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:14.527606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbc05dcdd7045de8bceeefee61b2857)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:14.529542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:14.573325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbc05dcdd7045de8bceeefee61b2857'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.582445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbc05dcdd7045de8bceeefee61b2857'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.585193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbc05dcdd7045de8bceeefee61b2857'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.598691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbc05dcdd7045de8bceeefee61b2857'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.611024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbc05dcdd7045de8bceeefee61b2857'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.617165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1028/2066] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:14 2022] DELETE /identity/v3/users/8cbc05dcdd7045de8bceeefee61b2857 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:14.787483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a7f0-9b85-47d3-a64e-e2d3e9a13d84 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:14.803768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a7f0-9b85-47d3-a64e-e2d3e9a13d84 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:14.840262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:14.876912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:14.877546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:14.877819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:14.878187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] PATH_INFO: `/v3/projects/8896c82ba91a4455a5f73dc80a1ff6f8` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:14.879320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8896c82ba91a4455a5f73dc80a1ff6f8)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:14.881279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:14.936670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8896c82ba91a4455a5f73dc80a1ff6f8', 'request_id': 'req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.945940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8896c82ba91a4455a5f73dc80a1ff6f8', 'request_id': 'req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.952505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8896c82ba91a4455a5f73dc80a1ff6f8', 'request_id': 'req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.971033 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] The token cache is being invalidate because project 8896c82ba91a4455a5f73dc80a1ff6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:14.971439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.972153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:14.975492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1039/2067] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:14 2022] DELETE /identity/v3/projects/8896c82ba91a4455a5f73dc80a1ff6f8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:14.979265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:14.980700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:14.991526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:14.992977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:14.995808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc950d3e-fee4-4660-9c84-e036f1af8a99 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:15.084217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6c78-f2cd-41f4-92b4-c2e208e07420 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:15.085033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:15.085829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.086098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.086387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] PATH_INFO: `/v3/users/f8ad645d95774112877d5a6a99ae133d` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.087979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ad645d95774112877d5a6a99ae133d)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:15.090157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:15.097315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:15.098231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.099290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.099290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] PATH_INFO: `/v3/users/41053bcdd52d4332932b2bbaf4a8a76a` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.100423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41053bcdd52d4332932b2bbaf4a8a76a)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:15.102971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:15.165381 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:15.179481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ad645d95774112877d5a6a99ae133d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.183076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41053bcdd52d4332932b2bbaf4a8a76a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.190041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ad645d95774112877d5a6a99ae133d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.191279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ad645d95774112877d5a6a99ae133d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.193319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41053bcdd52d4332932b2bbaf4a8a76a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.194573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41053bcdd52d4332932b2bbaf4a8a76a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.195244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41053bcdd52d4332932b2bbaf4a8a76a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.203906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ad645d95774112877d5a6a99ae133d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.212633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:15.213946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41053bcdd52d4332932b2bbaf4a8a76a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.221588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9a564545-65ea-43b9-9044-ed452ed28453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ad645d95774112877d5a6a99ae133d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.233354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1029/2068] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:14 2022] DELETE /identity/v3/users/f8ad645d95774112877d5a6a99ae133d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:15.233639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1040/2069] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:14 2022] DELETE /identity/v3/users/41053bcdd52d4332932b2bbaf4a8a76a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:15.236460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211874a3-3840-4eaa-b05c-a9119ab1ba73 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.236756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211874a3-3840-4eaa-b05c-a9119ab1ba73 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.237033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211874a3-3840-4eaa-b05c-a9119ab1ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.256715 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-211874a3-3840-4eaa-b05c-a9119ab1ba73 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:15.257949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-211874a3-3840-4eaa-b05c-a9119ab1ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:15.324105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1030/2070] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:15.331834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:15.333246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:15.401146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81cf0-a4cd-4a57-933f-d21d2144243b admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:15.405867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce85bf-4ac8-47c2-99d4-53b67cdf3ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:15.406584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce85bf-4ac8-47c2-99d4-53b67cdf3ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.406866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce85bf-4ac8-47c2-99d4-53b67cdf3ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.407142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce85bf-4ac8-47c2-99d4-53b67cdf3ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.418037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce85bf-4ac8-47c2-99d4-53b67cdf3ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:15.420334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce85bf-4ac8-47c2-99d4-53b67cdf3ae2 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:15.431598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1041/2071] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:15.600696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211874a3-3840-4eaa-b05c-a9119ab1ba73 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:15.602247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-211874a3-3840-4eaa-b05c-a9119ab1ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:15.615031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211874a3-3840-4eaa-b05c-a9119ab1ba73 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:15.627217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:15.628823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.629264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.629703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] PATH_INFO: `/v3/projects/c809426b13134dab997ecbbf872d12bf` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.638640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c809426b13134dab997ecbbf872d12bf)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:15.642562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:15.705813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c809426b13134dab997ecbbf872d12bf', 'request_id': 'req-a60434f8-4033-4937-a58b-2fcd653e16d0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.711704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c809426b13134dab997ecbbf872d12bf', 'request_id': 'req-a60434f8-4033-4937-a58b-2fcd653e16d0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.719079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c809426b13134dab997ecbbf872d12bf', 'request_id': 'req-a60434f8-4033-4937-a58b-2fcd653e16d0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.734993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] The token cache is being invalidate because project c809426b13134dab997ecbbf872d12bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:15.735385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.736158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.738159 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1031/2072] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:15 2022] DELETE /identity/v3/projects/c809426b13134dab997ecbbf872d12bf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:15.743457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63061e-fe26-4585-a022-defa8804c78f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.743765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63061e-fe26-4585-a022-defa8804c78f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.744058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63061e-fe26-4585-a022-defa8804c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.764792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8f63061e-fe26-4585-a022-defa8804c78f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:15.766020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8f63061e-fe26-4585-a022-defa8804c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:15.805340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:15.806826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:15.859414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:15.867978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1042/2073] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:15.876677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1d160-6c0d-40b3-846e-5967a6c6ee59 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.877058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1d160-6c0d-40b3-846e-5967a6c6ee59 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.877406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1d160-6c0d-40b3-846e-5967a6c6ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.887373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60434f8-4033-4937-a58b-2fcd653e16d0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:15.892653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:15.893566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.893853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.894168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] PATH_INFO: `/v3/projects/2643bc510ecb4efab577db9441a48a19` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.895972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2643bc510ecb4efab577db9441a48a19)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:15.897989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:15.899466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-0ab1d160-6c0d-40b3-846e-5967a6c6ee59 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:15.900775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0ab1d160-6c0d-40b3-846e-5967a6c6ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:15.909706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1043/2074] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:15.922102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1d160-6c0d-40b3-846e-5967a6c6ee59 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:15.934563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1d160-6c0d-40b3-846e-5967a6c6ee59 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:15.944299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:15.945310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:15.946015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:15.946015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:15.946755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:15.947073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:15.948687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:15.952952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2643bc510ecb4efab577db9441a48a19', 'request_id': 'req-65a1214c-a173-43f0-a02b-41d05ef0c265'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.959173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2643bc510ecb4efab577db9441a48a19', 'request_id': 'req-65a1214c-a173-43f0-a02b-41d05ef0c265'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.965624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1044/2075] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:30:15.965796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2643bc510ecb4efab577db9441a48a19', 'request_id': 'req-65a1214c-a173-43f0-a02b-41d05ef0c265'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.966679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:15.977200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43aba07-0be1-470c-9f51-6c411862ac27 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:15.979187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] The token cache is being invalidate because project 2643bc510ecb4efab577db9441a48a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:15.979477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.980110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:15.981627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1032/2076] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:15 2022] DELETE /identity/v3/projects/2643bc510ecb4efab577db9441a48a19 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:15.985565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:15.987351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.035184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.035780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.036061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.036328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.036940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.038884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.052502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1214c-a173-43f0-a02b-41d05ef0c265 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.054203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:16.058018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.058751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.059144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.059316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] PATH_INFO: `/v3/users/46df44657d1e4e3290a665944cfc9e12` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.060462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=46df44657d1e4e3290a665944cfc9e12)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.062764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.068224 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1045/2077] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:15 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:16.072330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.073919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.109292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46df44657d1e4e3290a665944cfc9e12'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.118084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46df44657d1e4e3290a665944cfc9e12'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.118783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46df44657d1e4e3290a665944cfc9e12'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.126822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46df44657d1e4e3290a665944cfc9e12'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.131662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:16.141128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46df44657d1e4e3290a665944cfc9e12'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.142845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94175c2f-310d-42bc-ae32-a336d6f96a20 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.147899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.148501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.148618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1033/2078] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:15 2022] DELETE /identity/v3/users/46df44657d1e4e3290a665944cfc9e12 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:16.148789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.149062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.149686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.151642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.174098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1046/2079] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:16 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:16.177819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.179405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.215741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.221370 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.237625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380290b-f270-4e4b-bb60-6730cc514d5b admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.259581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbabac-3d03-499f-a754-ea246a5ef1dd admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.264599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f54d-a6ec-4ca9-a5d0-cd0090e7d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.265210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f54d-a6ec-4ca9-a5d0-cd0090e7d40c admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.265769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f54d-a6ec-4ca9-a5d0-cd0090e7d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.265769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f54d-a6ec-4ca9-a5d0-cd0090e7d40c admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.266435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205f54d-a6ec-4ca9-a5d0-cd0090e7d40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.268118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205f54d-a6ec-4ca9-a5d0-cd0090e7d40c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.279002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1034/2080] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:16.283033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f54d-a6ec-4ca9-a5d0-cd0090e7d40c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.293187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f54d-a6ec-4ca9-a5d0-cd0090e7d40c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.297897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5ab1b-f32b-423b-9f30-49858ba3d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.299111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5ab1b-f32b-423b-9f30-49858ba3d92c admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.299396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5ab1b-f32b-423b-9f30-49858ba3d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.299676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5ab1b-f32b-423b-9f30-49858ba3d92c admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.301050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5ab1b-f32b-423b-9f30-49858ba3d92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.302113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5ab1b-f32b-423b-9f30-49858ba3d92c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.306834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.307847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.307992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.308262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] PATH_INFO: `/v3/users/3a1b37f5d7c44586b3e4beb32959857e` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.309583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1b37f5d7c44586b3e4beb32959857e)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.311803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.316275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1035/2081] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:30:16.317263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5ab1b-f32b-423b-9f30-49858ba3d92c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.330271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5ab1b-f32b-423b-9f30-49858ba3d92c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.336366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0387d8f-bb3b-4d12-ad15-1b4bc25b6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.337031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387d8f-bb3b-4d12-ad15-1b4bc25b6701 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.337376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387d8f-bb3b-4d12-ad15-1b4bc25b6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.337587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387d8f-bb3b-4d12-ad15-1b4bc25b6701 admin admin] PATH_INFO: `/v3/projects/68f9162345674648ad56660beaa7d07f/users/13225219a24a49a8a99e60ce2bd19a54/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.353919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0387d8f-bb3b-4d12-ad15-1b4bc25b6701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f9162345674648ad56660beaa7d07f, user_id=13225219a24a49a8a99e60ce2bd19a54, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.357608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0387d8f-bb3b-4d12-ad15-1b4bc25b6701 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.373117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1036/2082] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:16 2022] PUT /identity/v3/projects/68f9162345674648ad56660beaa7d07f/users/13225219a24a49a8a99e60ce2bd19a54/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:16.384045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a144-c259-4fa2-ae47-f1afba97c46b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.384342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a144-c259-4fa2-ae47-f1afba97c46b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.384626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a144-c259-4fa2-ae47-f1afba97c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.385225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1b37f5d7c44586b3e4beb32959857e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.394347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1b37f5d7c44586b3e4beb32959857e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.395219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1b37f5d7c44586b3e4beb32959857e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.396419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1b37f5d7c44586b3e4beb32959857e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.411663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dee89e80-27f4-4f15-8b7f-26a4f9aff7cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1b37f5d7c44586b3e4beb32959857e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.417849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-4075a144-c259-4fa2-ae47-f1afba97c46b None None] MFA Rules not processed for user `13225219a24a49a8a99e60ce2bd19a54`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:16.419792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4075a144-c259-4fa2-ae47-f1afba97c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.429472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1047/2083] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:16 2022] DELETE /identity/v3/users/3a1b37f5d7c44586b3e4beb32959857e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:16.433987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc565e-4cdd-4db6-adfc-5cfb0bf1d44f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.434495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc565e-4cdd-4db6-adfc-5cfb0bf1d44f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.434765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc565e-4cdd-4db6-adfc-5cfb0bf1d44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.443899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:16.461801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d3cc565e-4cdd-4db6-adfc-5cfb0bf1d44f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:16.463060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d3cc565e-4cdd-4db6-adfc-5cfb0bf1d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.507870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1037/2084] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:16.508677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075a144-c259-4fa2-ae47-f1afba97c46b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.510012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4075a144-c259-4fa2-ae47-f1afba97c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.562967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1048/2085] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:16.564237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc565e-4cdd-4db6-adfc-5cfb0bf1d44f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.565856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d3cc565e-4cdd-4db6-adfc-5cfb0bf1d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.567389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:16.607840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075a144-c259-4fa2-ae47-f1afba97c46b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.615175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.615830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.616413 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.617215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] PATH_INFO: `/v3/projects/52fd98479f0e49b48d02baf86e8a7bed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.618582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fd98479f0e49b48d02baf86e8a7bed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.621589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.635229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc565e-4cdd-4db6-adfc-5cfb0bf1d44f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.642845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f72c-8029-4c34-93e6-d285f1794374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.643795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f72c-8029-4c34-93e6-d285f1794374 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.644156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f72c-8029-4c34-93e6-d285f1794374 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.644502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f72c-8029-4c34-93e6-d285f1794374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.678389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fd98479f0e49b48d02baf86e8a7bed', 'request_id': 'req-6f1dd919-e316-4f64-9388-64a674de2c4c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.684431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fd98479f0e49b48d02baf86e8a7bed', 'request_id': 'req-6f1dd919-e316-4f64-9388-64a674de2c4c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.692363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fd98479f0e49b48d02baf86e8a7bed', 'request_id': 'req-6f1dd919-e316-4f64-9388-64a674de2c4c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.708981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] The token cache is being invalidate because project 52fd98479f0e49b48d02baf86e8a7bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:16.709276 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.710230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.711477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14f72c-8029-4c34-93e6-d285f1794374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.715097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1038/2086] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:16 2022] DELETE /identity/v3/projects/52fd98479f0e49b48d02baf86e8a7bed => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:16.715097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.715326 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14f72c-8029-4c34-93e6-d285f1794374 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.715419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.724117 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1049/2087] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:16.725584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c1e3-e63a-41aa-a06d-9967149db97a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.725942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c1e3-e63a-41aa-a06d-9967149db97a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.726377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c1e3-e63a-41aa-a06d-9967149db97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.747387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-1d93c1e3-e63a-41aa-a06d-9967149db97a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:16.748751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1d93c1e3-e63a-41aa-a06d-9967149db97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.786468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dd919-e316-4f64-9388-64a674de2c4c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.790616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ce9c9-914d-4437-b737-2e4cc05ff76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.790967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ce9c9-914d-4437-b737-2e4cc05ff76b service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.791394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ce9c9-914d-4437-b737-2e4cc05ff76b service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.792084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ce9c9-914d-4437-b737-2e4cc05ff76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.793887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e12ce9c9-914d-4437-b737-2e4cc05ff76b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.818329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:16.827491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1050/2088] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:16.828373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c1e3-e63a-41aa-a06d-9967149db97a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.829617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1d93c1e3-e63a-41aa-a06d-9967149db97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.841091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c1e3-e63a-41aa-a06d-9967149db97a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.846228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.846842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.847118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.847389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] PATH_INFO: `/v3/users/13225219a24a49a8a99e60ce2bd19a54` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.848496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13225219a24a49a8a99e60ce2bd19a54)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.854457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.864458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ce9c9-914d-4437-b737-2e4cc05ff76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.865923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ce9c9-914d-4437-b737-2e4cc05ff76b service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.875543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1039/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:16.876802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d575c7-f227-48e6-8913-152354fef72c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.877086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d575c7-f227-48e6-8913-152354fef72c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.877384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d575c7-f227-48e6-8913-152354fef72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.901435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-05d575c7-f227-48e6-8913-152354fef72c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:16.902698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-05d575c7-f227-48e6-8913-152354fef72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.905284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13225219a24a49a8a99e60ce2bd19a54'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.912836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1040/2090] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:16.914486 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13225219a24a49a8a99e60ce2bd19a54'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.915372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13225219a24a49a8a99e60ce2bd19a54'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.916103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13225219a24a49a8a99e60ce2bd19a54'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.917329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d575c7-f227-48e6-8913-152354fef72c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.928300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d575c7-f227-48e6-8913-152354fef72c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.932991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4e7b50b8-567f-421c-bf1e-cea25765b84b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13225219a24a49a8a99e60ce2bd19a54'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:16.934268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:16.934473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.934734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.935006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.935693 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:16.936081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:16.937794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:16.940862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:16.951214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1051/2091] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:16 2022] DELETE /identity/v3/users/13225219a24a49a8a99e60ce2bd19a54 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:16.956465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2f37-ce70-4bba-b817-ee5905c86f61 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:16.956690 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2f37-ce70-4bba-b817-ee5905c86f61 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:16.957054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2f37-ce70-4bba-b817-ee5905c86f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:16.957565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1041/2092] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:30:16.959100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:16.961341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:16.977396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e861f9-f866-461f-bafd-eba5eaadcf05 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:16.979431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-be0d2f37-ce70-4bba-b817-ee5905c86f61 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:16.980634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-be0d2f37-ce70-4bba-b817-ee5905c86f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.043828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfaa1-8785-42a3-9be5-3e06d0ec1ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.044525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfaa1-8785-42a3-9be5-3e06d0ec1ead admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.044875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfaa1-8785-42a3-9be5-3e06d0ec1ead admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.045222 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfaa1-8785-42a3-9be5-3e06d0ec1ead admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.045950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfaa1-8785-42a3-9be5-3e06d0ec1ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.047995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfaa1-8785-42a3-9be5-3e06d0ec1ead admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.065836 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1052/2093] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:17.073221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d2f37-ce70-4bba-b817-ee5905c86f61 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.074794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-be0d2f37-ce70-4bba-b817-ee5905c86f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.082423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1042/2094] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:16 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:17.087492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfaa1-8785-42a3-9be5-3e06d0ec1ead admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.145443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d2f37-ce70-4bba-b817-ee5905c86f61 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.158759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfaa1-8785-42a3-9be5-3e06d0ec1ead admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.166223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.166838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.167299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.167408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.167984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.169917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.175305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:17.196309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1043/2095] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:17 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:17.197105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.201195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.212164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7399fc-8785-4de3-9284-4be15fa9986b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.212910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7399fc-8785-4de3-9284-4be15fa9986b service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.213175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7399fc-8785-4de3-9284-4be15fa9986b service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.213442 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7399fc-8785-4de3-9284-4be15fa9986b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.214807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac7816-f991-44c1-b218-55c7c0d74dfe admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.219477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.221611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.221897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.222197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] PATH_INFO: `/v3/projects/f17974ccd44a4e14ae9073f765864b9d` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.223354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17974ccd44a4e14ae9073f765864b9d)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.225275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.225819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7399fc-8785-4de3-9284-4be15fa9986b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.228156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7399fc-8785-4de3-9284-4be15fa9986b service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.238496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1053/2096] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:17.239391 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7399fc-8785-4de3-9284-4be15fa9986b service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.248413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7399fc-8785-4de3-9284-4be15fa9986b service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.253764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd746-2783-4b26-9a9e-1ee8ff799bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.254435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd746-2783-4b26-9a9e-1ee8ff799bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.254656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd746-2783-4b26-9a9e-1ee8ff799bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.254968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd746-2783-4b26-9a9e-1ee8ff799bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.255589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfd746-2783-4b26-9a9e-1ee8ff799bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.257623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfd746-2783-4b26-9a9e-1ee8ff799bf1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.272265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1054/2097] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:17.276872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd746-2783-4b26-9a9e-1ee8ff799bf1 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.289290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd746-2783-4b26-9a9e-1ee8ff799bf1 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.301266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17974ccd44a4e14ae9073f765864b9d', 'request_id': 'req-b3c5bfb6-76b5-4ac0-a408-558382cb28df'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.308988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17974ccd44a4e14ae9073f765864b9d', 'request_id': 'req-b3c5bfb6-76b5-4ac0-a408-558382cb28df'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.317660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17974ccd44a4e14ae9073f765864b9d', 'request_id': 'req-b3c5bfb6-76b5-4ac0-a408-558382cb28df'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.323000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:17.334842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] The token cache is being invalidate because project f17974ccd44a4e14ae9073f765864b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:17.335186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.335943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.338813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1044/2098] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:17 2022] DELETE /identity/v3/projects/f17974ccd44a4e14ae9073f765864b9d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:17.366041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f21783-1598-43ba-99c7-d765046811a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.366860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21783-1598-43ba-99c7-d765046811a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.367220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21783-1598-43ba-99c7-d765046811a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.367554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21783-1598-43ba-99c7-d765046811a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.368315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f21783-1598-43ba-99c7-d765046811a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.370219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f21783-1598-43ba-99c7-d765046811a6 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.386426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1055/2099] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:17.387747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.389538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.410967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5bfb6-76b5-4ac0-a408-558382cb28df admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.416631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.417327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.417605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.417876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] PATH_INFO: `/v3/projects/cecd200729104331ab7304f139e000ad/users/db492288c0c84eaeb09b4a7c519770ac/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.436297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecd200729104331ab7304f139e000ad, user_id=db492288c0c84eaeb09b4a7c519770ac, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.440319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.461022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1045/2100] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:17 2022] PUT /identity/v3/projects/cecd200729104331ab7304f139e000ad/users/db492288c0c84eaeb09b4a7c519770ac/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:17.474673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861ec8-2bb6-435f-a67a-6b3c5eed5740 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.474881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861ec8-2bb6-435f-a67a-6b3c5eed5740 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.475107 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861ec8-2bb6-435f-a67a-6b3c5eed5740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.506890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-3c861ec8-2bb6-435f-a67a-6b3c5eed5740 None None] MFA Rules not processed for user `db492288c0c84eaeb09b4a7c519770ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:17.508134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3c861ec8-2bb6-435f-a67a-6b3c5eed5740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.564489 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.566593 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.591382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1056/2101] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:17.595601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861ec8-2bb6-435f-a67a-6b3c5eed5740 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.642853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:17.648533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a402-1341-470e-aefa-cb453fe7af76 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.653896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.654737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.655174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.655459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] PATH_INFO: `/v3/projects/68f9162345674648ad56660beaa7d07f` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.656584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f9162345674648ad56660beaa7d07f)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.658576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.659078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861ec8-2bb6-435f-a67a-6b3c5eed5740 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.663774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb20a9-08e2-4561-841b-e0e617d42e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.664373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb20a9-08e2-4561-841b-e0e617d42e1c admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.664655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb20a9-08e2-4561-841b-e0e617d42e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.664926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb20a9-08e2-4561-841b-e0e617d42e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.665578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb20a9-08e2-4561-841b-e0e617d42e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.667498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb20a9-08e2-4561-841b-e0e617d42e1c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.696415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1057/2102] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:17 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:17.700343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb20a9-08e2-4561-841b-e0e617d42e1c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.707262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f9162345674648ad56660beaa7d07f', 'request_id': 'req-2753cf63-97cf-4ad7-9677-7a8dcaab457f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.712952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f9162345674648ad56660beaa7d07f', 'request_id': 'req-2753cf63-97cf-4ad7-9677-7a8dcaab457f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.719341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f9162345674648ad56660beaa7d07f', 'request_id': 'req-2753cf63-97cf-4ad7-9677-7a8dcaab457f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.733599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] The token cache is being invalidate because project 68f9162345674648ad56660beaa7d07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:17.733895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.734569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-2753cf63-97cf-4ad7-9677-7a8dcaab457f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:17.736609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1046/2103] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:17 2022] DELETE /identity/v3/projects/68f9162345674648ad56660beaa7d07f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:17.741115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b95ea-733b-41ca-b09a-dbd7d986e22e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.741399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b95ea-733b-41ca-b09a-dbd7d986e22e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.741673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b95ea-733b-41ca-b09a-dbd7d986e22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.761082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d76b95ea-733b-41ca-b09a-dbd7d986e22e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:17.762316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d76b95ea-733b-41ca-b09a-dbd7d986e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.762892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb20a9-08e2-4561-841b-e0e617d42e1c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.767473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.768082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.768607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.768871 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.769484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.770486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1047/2104] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:17.771573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.777738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06636dc-f696-4088-82c3-ddbfb7965ad7 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.778027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06636dc-f696-4088-82c3-ddbfb7965ad7 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.778340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06636dc-f696-4088-82c3-ddbfb7965ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.796408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1058/2105] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:17 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:17.797574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.799764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.799877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e06636dc-f696-4088-82c3-ddbfb7965ad7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:17.801035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e06636dc-f696-4088-82c3-ddbfb7965ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:17.810817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1048/2106] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:17.811965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edee8f-9162-45bd-8935-b35b4c6006d3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.815342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06636dc-f696-4088-82c3-ddbfb7965ad7 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.818478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f86ec2-a3ae-45da-9e63-dfe38528e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.818478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86ec2-a3ae-45da-9e63-dfe38528e27a admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.818478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86ec2-a3ae-45da-9e63-dfe38528e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.818478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86ec2-a3ae-45da-9e63-dfe38528e27a admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.819060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f86ec2-a3ae-45da-9e63-dfe38528e27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.820624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f86ec2-a3ae-45da-9e63-dfe38528e27a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.825993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06636dc-f696-4088-82c3-ddbfb7965ad7 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.834958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1059/2107] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:17.835099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.835099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.835099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.835099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.835442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:17.835442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.836100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f86ec2-a3ae-45da-9e63-dfe38528e27a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.836231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.845806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f86ec2-a3ae-45da-9e63-dfe38528e27a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.848879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1049/2108] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:30:17.852315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee7c28-a4b8-430c-a542-d5c72cc99915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.853092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee7c28-a4b8-430c-a542-d5c72cc99915 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.853375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee7c28-a4b8-430c-a542-d5c72cc99915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.854367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee7c28-a4b8-430c-a542-d5c72cc99915 admin admin] PATH_INFO: `/v3/projects/80ec7e23a5954bf3bd7b7bb07e3eb4da/users/1f8a116579ea46b99f3b0da0c99b4290/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.854486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.867069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1efbc1-6474-4085-b918-c2c83e6ba29e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.872201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2003b98-1d1a-4a09-8228-3d668a243267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.872860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003b98-1d1a-4a09-8228-3d668a243267 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.873274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003b98-1d1a-4a09-8228-3d668a243267 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.873560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003b98-1d1a-4a09-8228-3d668a243267 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.873825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee7c28-a4b8-430c-a542-d5c72cc99915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ec7e23a5954bf3bd7b7bb07e3eb4da, user_id=1f8a116579ea46b99f3b0da0c99b4290, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.874217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2003b98-1d1a-4a09-8228-3d668a243267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.876181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2003b98-1d1a-4a09-8228-3d668a243267 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.877429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee7c28-a4b8-430c-a542-d5c72cc99915 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:17.897905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1060/2109] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:17 2022] PUT /identity/v3/projects/80ec7e23a5954bf3bd7b7bb07e3eb4da/users/1f8a116579ea46b99f3b0da0c99b4290/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:17.899184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee7c28-a4b8-430c-a542-d5c72cc99915 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.916005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1050/2110] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:17 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:17.919973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2003b98-1d1a-4a09-8228-3d668a243267 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:17.937734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:17.991262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee7c28-a4b8-430c-a542-d5c72cc99915 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.995992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537db76-e85b-4954-b3f4-3da2d531d9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:17.996615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db76-e85b-4954-b3f4-3da2d531d9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:17.996897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db76-e85b-4954-b3f4-3da2d531d9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:17.996994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2003b98-1d1a-4a09-8228-3d668a243267 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:17.997173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537db76-e85b-4954-b3f4-3da2d531d9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:17.997814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537db76-e85b-4954-b3f4-3da2d531d9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:17.999732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537db76-e85b-4954-b3f4-3da2d531d9a6 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.002484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8435f-8190-43ee-85c8-5e3aee6d5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.003105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8435f-8190-43ee-85c8-5e3aee6d5b05 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.003388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8435f-8190-43ee-85c8-5e3aee6d5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.003666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8435f-8190-43ee-85c8-5e3aee6d5b05 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.004292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8435f-8190-43ee-85c8-5e3aee6d5b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.006275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8435f-8190-43ee-85c8-5e3aee6d5b05 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.010840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1061/2111] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:18.014893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537db76-e85b-4954-b3f4-3da2d531d9a6 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:18.025926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537db76-e85b-4954-b3f4-3da2d531d9a6 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:18.031538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1051/2112] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:17 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:18.031682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4a2ea-6ed5-4c05-9009-c4ecc0485932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.031682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a2ea-6ed5-4c05-9009-c4ecc0485932 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.031892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a2ea-6ed5-4c05-9009-c4ecc0485932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.032054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a2ea-6ed5-4c05-9009-c4ecc0485932 admin admin] PATH_INFO: `/v3/projects/80ec7e23a5954bf3bd7b7bb07e3eb4da/users/1f8a116579ea46b99f3b0da0c99b4290/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.033322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8435f-8190-43ee-85c8-5e3aee6d5b05 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:18.034685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4a2ea-6ed5-4c05-9009-c4ecc0485932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ec7e23a5954bf3bd7b7bb07e3eb4da, user_id=1f8a116579ea46b99f3b0da0c99b4290, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.037377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4a2ea-6ed5-4c05-9009-c4ecc0485932 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.043022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8435f-8190-43ee-85c8-5e3aee6d5b05 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:18.047420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1062/2113] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:18 2022] PUT /identity/v3/projects/80ec7e23a5954bf3bd7b7bb07e3eb4da/users/1f8a116579ea46b99f3b0da0c99b4290/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:18.059339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e7d0-53d6-4401-8986-ed61f4196dc0 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.059696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e7d0-53d6-4401-8986-ed61f4196dc0 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.059974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e7d0-53d6-4401-8986-ed61f4196dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.079600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:18.089774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8af6e7d0-53d6-4401-8986-ed61f4196dc0 None None] MFA Rules not processed for user `1f8a116579ea46b99f3b0da0c99b4290`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:18.091326 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8af6e7d0-53d6-4401-8986-ed61f4196dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:18.105555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb1567-579a-40f7-8b00-c1ddd6e6d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.106191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1567-579a-40f7-8b00-c1ddd6e6d2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.106473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1567-579a-40f7-8b00-c1ddd6e6d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.106744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1567-579a-40f7-8b00-c1ddd6e6d2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.107383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb1567-579a-40f7-8b00-c1ddd6e6d2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.108973 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb1567-579a-40f7-8b00-c1ddd6e6d2f2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.119382 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1052/2114] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:30:18.123205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb1567-579a-40f7-8b00-c1ddd6e6d2f2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:18.132873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb1567-579a-40f7-8b00-c1ddd6e6d2f2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:18.137533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e742ea-5816-46ee-96e1-260dd4002046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.138134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e742ea-5816-46ee-96e1-260dd4002046 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.138422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e742ea-5816-46ee-96e1-260dd4002046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.138801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e742ea-5816-46ee-96e1-260dd4002046 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.139338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e742ea-5816-46ee-96e1-260dd4002046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.140907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e742ea-5816-46ee-96e1-260dd4002046 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.154731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1053/2115] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:30:18.155675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e742ea-5816-46ee-96e1-260dd4002046 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:18.165713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e742ea-5816-46ee-96e1-260dd4002046 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:18.166160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1063/2116] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:18.170448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4660b7-4489-4843-b887-d11746a4f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.171082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4660b7-4489-4843-b887-d11746a4f790 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.171812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4660b7-4489-4843-b887-d11746a4f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.171812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4660b7-4489-4843-b887-d11746a4f790 admin admin] PATH_INFO: `/v3/projects/41826fb666484cc995bffeb84133f348/users/1779fd01f62549ddac59da145a0618e6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.177840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e7d0-53d6-4401-8986-ed61f4196dc0 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:18.179249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8af6e7d0-53d6-4401-8986-ed61f4196dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:18.188824 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4660b7-4489-4843-b887-d11746a4f790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41826fb666484cc995bffeb84133f348, user_id=1779fd01f62549ddac59da145a0618e6, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.191615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4660b7-4489-4843-b887-d11746a4f790 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.205167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1054/2117] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:18 2022] PUT /identity/v3/projects/41826fb666484cc995bffeb84133f348/users/1779fd01f62549ddac59da145a0618e6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:18.216768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010386b-23a0-4b19-b51b-c584cd30fd12 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.217148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010386b-23a0-4b19-b51b-c584cd30fd12 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.217435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010386b-23a0-4b19-b51b-c584cd30fd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.238640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e7d0-53d6-4401-8986-ed61f4196dc0 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:18.247317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b010386b-23a0-4b19-b51b-c584cd30fd12 None None] MFA Rules not processed for user `1779fd01f62549ddac59da145a0618e6`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:18.248534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b010386b-23a0-4b19-b51b-c584cd30fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:18.292207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1662fd-416d-428e-976e-ab320470fa68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.292821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1662fd-416d-428e-976e-ab320470fa68 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.293106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1662fd-416d-428e-976e-ab320470fa68 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.293382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1662fd-416d-428e-976e-ab320470fa68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.304302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:18.322622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1055/2118] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:30:18.333683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010386b-23a0-4b19-b51b-c584cd30fd12 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:18.335094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b010386b-23a0-4b19-b51b-c584cd30fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:18.347093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010386b-23a0-4b19-b51b-c584cd30fd12 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:18.350674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c02f-5129-4167-b086-543c62b82afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.351260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c02f-5129-4167-b086-543c62b82afd service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.351538 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c02f-5129-4167-b086-543c62b82afd service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.351810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c02f-5129-4167-b086-543c62b82afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.356843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1662fd-416d-428e-976e-ab320470fa68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.358304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1662fd-416d-428e-976e-ab320470fa68 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.359913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781c02f-5129-4167-b086-543c62b82afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.361948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781c02f-5129-4167-b086-543c62b82afd service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.363868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:18.369325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1064/2119] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:30:18.371784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1056/2120] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:30:18.502605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1662fd-416d-428e-976e-ab320470fa68 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:18.570417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1662fd-416d-428e-976e-ab320470fa68 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:18.575298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.583576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.583576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.583576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] PATH_INFO: `/v3/users/db492288c0c84eaeb09b4a7c519770ac` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.583576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db492288c0c84eaeb09b4a7c519770ac)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.583576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.640050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db492288c0c84eaeb09b4a7c519770ac'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:18.649998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db492288c0c84eaeb09b4a7c519770ac'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:18.650945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db492288c0c84eaeb09b4a7c519770ac'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:18.653094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db492288c0c84eaeb09b4a7c519770ac'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:18.668775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db492288c0c84eaeb09b4a7c519770ac'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:18.695096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1065/2121] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:18 2022] DELETE /identity/v3/users/db492288c0c84eaeb09b4a7c519770ac => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:18.696686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457d4c-066b-492d-a1a0-4b0ca4ba5b96 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.697208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457d4c-066b-492d-a1a0-4b0ca4ba5b96 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.697398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457d4c-066b-492d-a1a0-4b0ca4ba5b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.717768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-81457d4c-066b-492d-a1a0-4b0ca4ba5b96 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:18.719095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-81457d4c-066b-492d-a1a0-4b0ca4ba5b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:18.780477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1057/2122] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:18.790354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:18.791782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:18.848279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ce37b-5bfa-4563-8211-7a0b4a861b2d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:18.852010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294b8f4-410d-4b3c-a2e7-12e5d75ad9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:18.852617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294b8f4-410d-4b3c-a2e7-12e5d75ad9ef service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:18.852901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294b8f4-410d-4b3c-a2e7-12e5d75ad9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:18.853178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294b8f4-410d-4b3c-a2e7-12e5d75ad9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:18.862676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294b8f4-410d-4b3c-a2e7-12e5d75ad9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:18.864102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294b8f4-410d-4b3c-a2e7-12e5d75ad9ef service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:18.873502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1066/2123] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:19.148511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457d4c-066b-492d-a1a0-4b0ca4ba5b96 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:19.149999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-81457d4c-066b-492d-a1a0-4b0ca4ba5b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:19.161752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457d4c-066b-492d-a1a0-4b0ca4ba5b96 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:19.166368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:19.166993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:19.167284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:19.167529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] PATH_INFO: `/v3/projects/cecd200729104331ab7304f139e000ad` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:19.168683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cecd200729104331ab7304f139e000ad)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:19.170637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:19.217753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cecd200729104331ab7304f139e000ad', 'request_id': 'req-48251780-324e-4a48-aa88-e5c53d402fe1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.223213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cecd200729104331ab7304f139e000ad', 'request_id': 'req-48251780-324e-4a48-aa88-e5c53d402fe1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.229380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cecd200729104331ab7304f139e000ad', 'request_id': 'req-48251780-324e-4a48-aa88-e5c53d402fe1'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.241780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] The token cache is being invalidate because project cecd200729104331ab7304f139e000ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:19.242083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.242698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.244158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1058/2124] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:19 2022] DELETE /identity/v3/projects/cecd200729104331ab7304f139e000ad => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:19.248179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294b8f4-410d-4b3c-a2e7-12e5d75ad9ef service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:19.258472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294b8f4-410d-4b3c-a2e7-12e5d75ad9ef service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:19.276234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:19.317488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:19.318148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:19.318433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:19.318708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] PATH_INFO: `/v3/users/1f8a116579ea46b99f3b0da0c99b4290` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:19.319821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8a116579ea46b99f3b0da0c99b4290)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:19.321745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:19.365454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8a116579ea46b99f3b0da0c99b4290'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.372914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8a116579ea46b99f3b0da0c99b4290'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.373621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8a116579ea46b99f3b0da0c99b4290'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.374299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8a116579ea46b99f3b0da0c99b4290'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.386819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c2c97b95-54b3-45da-8151-ac3caf97e93a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8a116579ea46b99f3b0da0c99b4290'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.399113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1067/2125] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:19 2022] DELETE /identity/v3/users/1f8a116579ea46b99f3b0da0c99b4290 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:19.666630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:19.668179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:19.684510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251780-324e-4a48-aa88-e5c53d402fe1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:19.744727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:19.745366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:19.745648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:19.745932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] PATH_INFO: `/v3/projects/80ec7e23a5954bf3bd7b7bb07e3eb4da` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:19.747124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ec7e23a5954bf3bd7b7bb07e3eb4da)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:19.748967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:19.751756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:19.798647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ec7e23a5954bf3bd7b7bb07e3eb4da', 'request_id': 'req-20942988-bbdf-4aff-906b-b359d671607b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.804187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ec7e23a5954bf3bd7b7bb07e3eb4da', 'request_id': 'req-20942988-bbdf-4aff-906b-b359d671607b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.810686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ec7e23a5954bf3bd7b7bb07e3eb4da', 'request_id': 'req-20942988-bbdf-4aff-906b-b359d671607b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.824028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] The token cache is being invalidate because project 80ec7e23a5954bf3bd7b7bb07e3eb4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:19.824345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.824975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-20942988-bbdf-4aff-906b-b359d671607b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:19.826515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1059/2126] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:19 2022] DELETE /identity/v3/projects/80ec7e23a5954bf3bd7b7bb07e3eb4da => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:19.831620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2dd8e-6010-4ed6-81b6-a9332ce3ede0 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:19.831924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2dd8e-6010-4ed6-81b6-a9332ce3ede0 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:19.832325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2dd8e-6010-4ed6-81b6-a9332ce3ede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:19.859433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-80e2dd8e-6010-4ed6-81b6-a9332ce3ede0 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:19.861761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-80e2dd8e-6010-4ed6-81b6-a9332ce3ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:19.943938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1068/2127] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:19.955740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f648e5-0a0e-4b7a-847b-cc6766150b16 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:19.956055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f648e5-0a0e-4b7a-847b-cc6766150b16 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:19.956327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f648e5-0a0e-4b7a-847b-cc6766150b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:19.977111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d3f648e5-0a0e-4b7a-847b-cc6766150b16 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:19.978501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d3f648e5-0a0e-4b7a-847b-cc6766150b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:19.986529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1060/2128] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:19.990758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2dd8e-6010-4ed6-81b6-a9332ce3ede0 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.000592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2dd8e-6010-4ed6-81b6-a9332ce3ede0 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.005311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.005889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.006212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.006488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.007130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:20.007434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.009021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.021677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1069/2129] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:30:20.025912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f648e5-0a0e-4b7a-847b-cc6766150b16 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.036064 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f648e5-0a0e-4b7a-847b-cc6766150b16 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.040754 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4170f-cf95-4c7f-9c12-5fdcab810ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.041341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4170f-cf95-4c7f-9c12-5fdcab810ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.041626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4170f-cf95-4c7f-9c12-5fdcab810ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.041901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4170f-cf95-4c7f-9c12-5fdcab810ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.042571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4170f-cf95-4c7f-9c12-5fdcab810ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.044484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4170f-cf95-4c7f-9c12-5fdcab810ae1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.070726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1061/2130] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:20 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:20.075004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.085303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4b46-e70d-4001-aba5-526589fe1557 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.110708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:20.142868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bf09c-59f6-42ca-bde4-e0e50bb7ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.143736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bf09c-59f6-42ca-bde4-e0e50bb7ec8f admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.144018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bf09c-59f6-42ca-bde4-e0e50bb7ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.144294 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bf09c-59f6-42ca-bde4-e0e50bb7ec8f admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.144912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bf09c-59f6-42ca-bde4-e0e50bb7ec8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.146903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bf09c-59f6-42ca-bde4-e0e50bb7ec8f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.169159 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1070/2131] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:20 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:20.173089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4170f-cf95-4c7f-9c12-5fdcab810ae1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.184191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4170f-cf95-4c7f-9c12-5fdcab810ae1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.188917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3bcb3-f1d2-43dc-8737-8d470079aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.189522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3bcb3-f1d2-43dc-8737-8d470079aaaa admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.189803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3bcb3-f1d2-43dc-8737-8d470079aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.190103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3bcb3-f1d2-43dc-8737-8d470079aaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.190753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3bcb3-f1d2-43dc-8737-8d470079aaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.192366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3bcb3-f1d2-43dc-8737-8d470079aaaa admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.202435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1062/2132] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:20.206924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bf09c-59f6-42ca-bde4-e0e50bb7ec8f admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.217143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bf09c-59f6-42ca-bde4-e0e50bb7ec8f admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.222584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644307d-dc64-441c-a361-e1d37e5623a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.223194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644307d-dc64-441c-a361-e1d37e5623a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.223476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644307d-dc64-441c-a361-e1d37e5623a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.223755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644307d-dc64-441c-a361-e1d37e5623a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.224403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644307d-dc64-441c-a361-e1d37e5623a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.226364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644307d-dc64-441c-a361-e1d37e5623a9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.238735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1071/2133] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:20.243032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3bcb3-f1d2-43dc-8737-8d470079aaaa admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.253740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3bcb3-f1d2-43dc-8737-8d470079aaaa admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.258385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41e40-d0a6-40d8-9511-cc8c6d12978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.259060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41e40-d0a6-40d8-9511-cc8c6d12978b admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.259339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41e40-d0a6-40d8-9511-cc8c6d12978b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.259612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41e40-d0a6-40d8-9511-cc8c6d12978b admin admin] PATH_INFO: `/v3/projects/96e41d1679ff488fa7e21c8f44f1f699/users/64c63405cd604e49853e9cde73e45b16/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.275296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a41e40-d0a6-40d8-9511-cc8c6d12978b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e41d1679ff488fa7e21c8f44f1f699, user_id=64c63405cd604e49853e9cde73e45b16, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.278195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a41e40-d0a6-40d8-9511-cc8c6d12978b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.293639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1063/2134] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:20 2022] PUT /identity/v3/projects/96e41d1679ff488fa7e21c8f44f1f699/users/64c63405cd604e49853e9cde73e45b16/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:20.303675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5441d0-683b-43f1-85e3-bdb49615bab7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.304197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5441d0-683b-43f1-85e3-bdb49615bab7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.304197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5441d0-683b-43f1-85e3-bdb49615bab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.334709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-cb5441d0-683b-43f1-85e3-bdb49615bab7 None None] MFA Rules not processed for user `64c63405cd604e49853e9cde73e45b16`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:20.335971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cb5441d0-683b-43f1-85e3-bdb49615bab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:20.403356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1072/2135] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:20.407918 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41e40-d0a6-40d8-9511-cc8c6d12978b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.469671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41e40-d0a6-40d8-9511-cc8c6d12978b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.474404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b4a71-f1fc-4a93-9335-207e7706dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.475002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b4a71-f1fc-4a93-9335-207e7706dc20 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.475281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b4a71-f1fc-4a93-9335-207e7706dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.475552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b4a71-f1fc-4a93-9335-207e7706dc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.476181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b4a71-f1fc-4a93-9335-207e7706dc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.478104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b4a71-f1fc-4a93-9335-207e7706dc20 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.504173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1064/2136] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:20 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:20.508177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5441d0-683b-43f1-85e3-bdb49615bab7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.519670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5441d0-683b-43f1-85e3-bdb49615bab7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.576528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756af92-06a7-4464-9317-13256f8cc5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.577163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756af92-06a7-4464-9317-13256f8cc5af admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.577443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756af92-06a7-4464-9317-13256f8cc5af admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.577715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756af92-06a7-4464-9317-13256f8cc5af admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.578384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756af92-06a7-4464-9317-13256f8cc5af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.580884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756af92-06a7-4464-9317-13256f8cc5af admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.601032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1073/2137] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:20 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:20.605025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b4a71-f1fc-4a93-9335-207e7706dc20 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.615156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b4a71-f1fc-4a93-9335-207e7706dc20 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.619743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8488-a959-4657-b547-2c6e64f699f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.620331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8488-a959-4657-b547-2c6e64f699f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.620613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8488-a959-4657-b547-2c6e64f699f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.620887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8488-a959-4657-b547-2c6e64f699f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.621528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb8488-a959-4657-b547-2c6e64f699f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.623222 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb8488-a959-4657-b547-2c6e64f699f2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.634929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1065/2138] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:20.639079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756af92-06a7-4464-9317-13256f8cc5af admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.650177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756af92-06a7-4464-9317-13256f8cc5af admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.654986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a7cf6-281f-4c13-9149-40d45c689d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.655627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a7cf6-281f-4c13-9149-40d45c689d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.655915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a7cf6-281f-4c13-9149-40d45c689d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.656195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a7cf6-281f-4c13-9149-40d45c689d70 admin admin] PATH_INFO: `/v3/projects/2f254c264b64478b904dba1ba091d1e5/users/043caf18b0d14f42852b22a70088939c/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.670765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a7cf6-281f-4c13-9149-40d45c689d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f254c264b64478b904dba1ba091d1e5, user_id=043caf18b0d14f42852b22a70088939c, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.673908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a7cf6-281f-4c13-9149-40d45c689d70 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.686418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1074/2139] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:20 2022] PUT /identity/v3/projects/2f254c264b64478b904dba1ba091d1e5/users/043caf18b0d14f42852b22a70088939c/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:30:20.690873 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8488-a959-4657-b547-2c6e64f699f2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.695910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:20.701895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8488-a959-4657-b547-2c6e64f699f2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.759826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c3ce-9113-459c-a5bd-52cab9636b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.760414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c3ce-9113-459c-a5bd-52cab9636b29 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.760623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c3ce-9113-459c-a5bd-52cab9636b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.760895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c3ce-9113-459c-a5bd-52cab9636b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.761529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32c3ce-9113-459c-a5bd-52cab9636b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.763153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32c3ce-9113-459c-a5bd-52cab9636b29 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.772892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1066/2140] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:20.777005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a7cf6-281f-4c13-9149-40d45c689d70 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.782543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:20.788948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a7cf6-281f-4c13-9149-40d45c689d70 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:20.794423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:20.795062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.795341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.795613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] PATH_INFO: `/v3/projects/2f254c264b64478b904dba1ba091d1e5/users/043caf18b0d14f42852b22a70088939c/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.797498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f254c264b64478b904dba1ba091d1e5, user_id=043caf18b0d14f42852b22a70088939c, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:20.800660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:20.810772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1075/2141] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:20 2022] PUT /identity/v3/projects/2f254c264b64478b904dba1ba091d1e5/users/043caf18b0d14f42852b22a70088939c/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:20.822202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f67c4-8260-4b5a-8d1c-98cfd0ba057b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:20.822491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f67c4-8260-4b5a-8d1c-98cfd0ba057b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:20.822767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f67c4-8260-4b5a-8d1c-98cfd0ba057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:20.854504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-486f67c4-8260-4b5a-8d1c-98cfd0ba057b None None] MFA Rules not processed for user `043caf18b0d14f42852b22a70088939c`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:20.854504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-486f67c4-8260-4b5a-8d1c-98cfd0ba057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:20.917968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1067/2142] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:20.931941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:20.933631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:20.996561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717037f-fd7d-454a-8c5c-57083e9c648c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:21.001034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9764ca-1ffd-47ea-909a-200ba8cfd179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:21.002402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9764ca-1ffd-47ea-909a-200ba8cfd179 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:21.002687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9764ca-1ffd-47ea-909a-200ba8cfd179 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:21.002962 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9764ca-1ffd-47ea-909a-200ba8cfd179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:21.013018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9764ca-1ffd-47ea-909a-200ba8cfd179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:21.014418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9764ca-1ffd-47ea-909a-200ba8cfd179 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:21.023993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1076/2143] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:21.610970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f67c4-8260-4b5a-8d1c-98cfd0ba057b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:21.673624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f67c4-8260-4b5a-8d1c-98cfd0ba057b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:21.678043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:21.678680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:21.678959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:21.679237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] PATH_INFO: `/v3/users/64c63405cd604e49853e9cde73e45b16` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:21.680326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c63405cd604e49853e9cde73e45b16)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:21.682315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:21.708891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:21.729173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c63405cd604e49853e9cde73e45b16'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:21.736213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c63405cd604e49853e9cde73e45b16'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:21.737025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c63405cd604e49853e9cde73e45b16'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:21.744335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c63405cd604e49853e9cde73e45b16'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:21.756329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c63405cd604e49853e9cde73e45b16'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:21.762021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1068/2144] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:21 2022] DELETE /identity/v3/users/64c63405cd604e49853e9cde73e45b16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:21.766499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624cebe-28c7-4e55-bc53-04fda0e22a0a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:21.767404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624cebe-28c7-4e55-bc53-04fda0e22a0a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:21.767659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624cebe-28c7-4e55-bc53-04fda0e22a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:21.787208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-3624cebe-28c7-4e55-bc53-04fda0e22a0a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:21.788409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3624cebe-28c7-4e55-bc53-04fda0e22a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:21.846331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1077/2145] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:21.855982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:21.857463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:21.914317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9cf9-3662-4325-81a5-2e533e2c0fa0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:21.917896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75ff66-a8f2-48a7-b651-0a35598bcdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:21.918527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ff66-a8f2-48a7-b651-0a35598bcdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:21.918812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ff66-a8f2-48a7-b651-0a35598bcdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:21.919086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ff66-a8f2-48a7-b651-0a35598bcdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:21.928173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75ff66-a8f2-48a7-b651-0a35598bcdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:21.929669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75ff66-a8f2-48a7-b651-0a35598bcdc5 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:21.939510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1069/2146] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:22.211399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624cebe-28c7-4e55-bc53-04fda0e22a0a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:22.213000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3624cebe-28c7-4e55-bc53-04fda0e22a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:22.227958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624cebe-28c7-4e55-bc53-04fda0e22a0a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:22.233793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:22.234755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:22.235199 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:22.236166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] PATH_INFO: `/v3/projects/96e41d1679ff488fa7e21c8f44f1f699` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:22.237597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e41d1679ff488fa7e21c8f44f1f699)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:22.239687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:22.294800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e41d1679ff488fa7e21c8f44f1f699', 'request_id': 'req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.301541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e41d1679ff488fa7e21c8f44f1f699', 'request_id': 'req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.308182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e41d1679ff488fa7e21c8f44f1f699', 'request_id': 'req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.321041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] The token cache is being invalidate because project 96e41d1679ff488fa7e21c8f44f1f699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:22.321332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.321950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.323488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1078/2147] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:22 2022] DELETE /identity/v3/projects/96e41d1679ff488fa7e21c8f44f1f699 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:22.327624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75ff66-a8f2-48a7-b651-0a35598bcdc5 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:22.337436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75ff66-a8f2-48a7-b651-0a35598bcdc5 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:22.394882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:22.395424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:22.395707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:22.395986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] PATH_INFO: `/v3/users/043caf18b0d14f42852b22a70088939c` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:22.397108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043caf18b0d14f42852b22a70088939c)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:22.399076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:22.444394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043caf18b0d14f42852b22a70088939c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.446042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:22.452994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043caf18b0d14f42852b22a70088939c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.454070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043caf18b0d14f42852b22a70088939c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.461342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043caf18b0d14f42852b22a70088939c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.473117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-997771fc-f14d-4ebc-b05c-469db37756d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043caf18b0d14f42852b22a70088939c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.478899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1070/2148] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:22 2022] DELETE /identity/v3/users/043caf18b0d14f42852b22a70088939c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:22.794849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:22.796381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:22.813747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d84b31-490a-4dd1-b7e9-34c5a4ff73aa admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:22.826096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:22.876701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:22.877329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:22.877611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:22.877884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] PATH_INFO: `/v3/projects/2f254c264b64478b904dba1ba091d1e5` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:22.879016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f254c264b64478b904dba1ba091d1e5)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:22.880973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:22.932445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f254c264b64478b904dba1ba091d1e5', 'request_id': 'req-89f8fa49-3c80-4e27-a5da-7924e7c1286f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.938897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f254c264b64478b904dba1ba091d1e5', 'request_id': 'req-89f8fa49-3c80-4e27-a5da-7924e7c1286f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.945814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f254c264b64478b904dba1ba091d1e5', 'request_id': 'req-89f8fa49-3c80-4e27-a5da-7924e7c1286f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.958099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] The token cache is being invalidate because project 2f254c264b64478b904dba1ba091d1e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:22.958339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.958960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-89f8fa49-3c80-4e27-a5da-7924e7c1286f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:22.960468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1079/2149] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:22 2022] DELETE /identity/v3/projects/2f254c264b64478b904dba1ba091d1e5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:22.965467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cd8d-4547-4eeb-a32e-43478505718a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:22.965937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cd8d-4547-4eeb-a32e-43478505718a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:22.966051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cd8d-4547-4eeb-a32e-43478505718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:22.986317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8874cd8d-4547-4eeb-a32e-43478505718a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:22.987519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8874cd8d-4547-4eeb-a32e-43478505718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:23.047184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1071/2150] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:23.055728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a71fd-8190-49d8-8cad-3be64b6a4e58 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.056022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a71fd-8190-49d8-8cad-3be64b6a4e58 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.056305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a71fd-8190-49d8-8cad-3be64b6a4e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.075755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-5a1a71fd-8190-49d8-8cad-3be64b6a4e58 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:23.076964 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5a1a71fd-8190-49d8-8cad-3be64b6a4e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:23.085418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1080/2151] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:23.089518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874cd8d-4547-4eeb-a32e-43478505718a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:23.099169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874cd8d-4547-4eeb-a32e-43478505718a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:23.103972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:23.104569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.104855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.105134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.105795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:23.106137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:23.107749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:23.119892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1072/2152] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:30:23.123720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a71fd-8190-49d8-8cad-3be64b6a4e58 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:23.133608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a71fd-8190-49d8-8cad-3be64b6a4e58 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:23.138385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f18c8-838f-4110-92ca-7e67749b7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:23.138980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f18c8-838f-4110-92ca-7e67749b7e13 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.139263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f18c8-838f-4110-92ca-7e67749b7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.139543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f18c8-838f-4110-92ca-7e67749b7e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.140203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f18c8-838f-4110-92ca-7e67749b7e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:23.142148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f18c8-838f-4110-92ca-7e67749b7e13 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:23.168373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1081/2153] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:23 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:23.172468 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:23.182834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b7d64-657d-4cc4-9229-6873d2d0d371 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:23.238554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7ab34-ddd7-4f10-b4c4-51de535cf075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:23.239138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ab34-ddd7-4f10-b4c4-51de535cf075 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.239461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ab34-ddd7-4f10-b4c4-51de535cf075 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.239775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ab34-ddd7-4f10-b4c4-51de535cf075 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.240386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7ab34-ddd7-4f10-b4c4-51de535cf075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:23.242338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7ab34-ddd7-4f10-b4c4-51de535cf075 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:23.263174 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1073/2154] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:23 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:23.267408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f18c8-838f-4110-92ca-7e67749b7e13 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:23.277851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f18c8-838f-4110-92ca-7e67749b7e13 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:23.282998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbd2c9-a877-40fa-aadc-7ec1bc8de52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:23.283583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd2c9-a877-40fa-aadc-7ec1bc8de52b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.283862 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd2c9-a877-40fa-aadc-7ec1bc8de52b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.284134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd2c9-a877-40fa-aadc-7ec1bc8de52b admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.284773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbd2c9-a877-40fa-aadc-7ec1bc8de52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:23.286372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbd2c9-a877-40fa-aadc-7ec1bc8de52b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:23.296365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1082/2155] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:23.300659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7ab34-ddd7-4f10-b4c4-51de535cf075 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:23.310428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7ab34-ddd7-4f10-b4c4-51de535cf075 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:23.319023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590ea95-e932-4d7d-8be5-e30f89d12379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:23.319646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590ea95-e932-4d7d-8be5-e30f89d12379 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.319930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590ea95-e932-4d7d-8be5-e30f89d12379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.320202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590ea95-e932-4d7d-8be5-e30f89d12379 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.320856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590ea95-e932-4d7d-8be5-e30f89d12379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:23.322571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590ea95-e932-4d7d-8be5-e30f89d12379 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:23.337784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1074/2156] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:23.339080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbd2c9-a877-40fa-aadc-7ec1bc8de52b admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:23.349724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbd2c9-a877-40fa-aadc-7ec1bc8de52b admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:23.358584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:23.359235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.359621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.359896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] PATH_INFO: `/v3/projects/d11e464dfd504186a1dfbf42799bf0f3/users/f997129b88604f4c805f79832166f24b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.375081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11e464dfd504186a1dfbf42799bf0f3, user_id=f997129b88604f4c805f79832166f24b, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:23.377758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:23.389919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1083/2157] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:23 2022] PUT /identity/v3/projects/d11e464dfd504186a1dfbf42799bf0f3/users/f997129b88604f4c805f79832166f24b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:23.401426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989fa0f-af01-440a-82f3-6aea831ec8dd None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.401727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989fa0f-af01-440a-82f3-6aea831ec8dd None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.402009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989fa0f-af01-440a-82f3-6aea831ec8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.431270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3989fa0f-af01-440a-82f3-6aea831ec8dd None None] MFA Rules not processed for user `f997129b88604f4c805f79832166f24b`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:23.432514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3989fa0f-af01-440a-82f3-6aea831ec8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:23.450652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:23.499116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1075/2158] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:23.510098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:23.512051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:23.561551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:23.595664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931ca0-02dc-4513-adb6-64da0590903c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:23.599342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949f812-a925-4f31-ac04-4c2ad14ef6ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d5fb05964b47d5a2f33fe9dde1f65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:23.599942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949f812-a925-4f31-ac04-4c2ad14ef6ea service glance] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:23.600223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949f812-a925-4f31-ac04-4c2ad14ef6ea service glance] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:23.600496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949f812-a925-4f31-ac04-4c2ad14ef6ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:23.608590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949f812-a925-4f31-ac04-4c2ad14ef6ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:23.609997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949f812-a925-4f31-ac04-4c2ad14ef6ea service glance] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:23.619733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1084/2159] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:30:31.976956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989fa0f-af01-440a-82f3-6aea831ec8dd None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:31.978406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3989fa0f-af01-440a-82f3-6aea831ec8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:32.041309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989fa0f-af01-440a-82f3-6aea831ec8dd None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:32.045779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:32.046420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:32.046697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:32.046965 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] PATH_INFO: `/v3/users/1779fd01f62549ddac59da145a0618e6` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:32.048077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1779fd01f62549ddac59da145a0618e6)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:32.049993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:32.099699 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1779fd01f62549ddac59da145a0618e6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.106812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1779fd01f62549ddac59da145a0618e6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.107421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1779fd01f62549ddac59da145a0618e6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.114329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1779fd01f62549ddac59da145a0618e6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.126495 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1779fd01f62549ddac59da145a0618e6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.132878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1076/2160] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:31 2022] DELETE /identity/v3/users/1779fd01f62549ddac59da145a0618e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:32.137321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6419e-b5c2-4441-8de7-08e2d619a51a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:32.137797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6419e-b5c2-4441-8de7-08e2d619a51a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:32.137891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6419e-b5c2-4441-8de7-08e2d619a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:32.156351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9fc6419e-b5c2-4441-8de7-08e2d619a51a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:32.157532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9fc6419e-b5c2-4441-8de7-08e2d619a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:32.219358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1085/2161] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:32.229310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:32.230753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:32.273767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:32.289915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85243157-22d9-48eb-956f-abd821105f59 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:32.293564 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bc74b-b056-4ee5-b55b-150c3cc63fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:32.294769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc74b-b056-4ee5-b55b-150c3cc63fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:32.295079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc74b-b056-4ee5-b55b-150c3cc63fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:32.295411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc74b-b056-4ee5-b55b-150c3cc63fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:32.305288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bc74b-b056-4ee5-b55b-150c3cc63fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:32.306754 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bc74b-b056-4ee5-b55b-150c3cc63fc0 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:32.316304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1077/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:32.612784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6419e-b5c2-4441-8de7-08e2d619a51a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:32.614989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9fc6419e-b5c2-4441-8de7-08e2d619a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:32.627620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6419e-b5c2-4441-8de7-08e2d619a51a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:32.632633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:32.633363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:32.633786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:32.634222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] PATH_INFO: `/v3/projects/41826fb666484cc995bffeb84133f348` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:32.635894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41826fb666484cc995bffeb84133f348)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:32.637884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:32.694100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41826fb666484cc995bffeb84133f348', 'request_id': 'req-22d69bc5-13db-4f29-bd8f-1e612c069179'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.699532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41826fb666484cc995bffeb84133f348', 'request_id': 'req-22d69bc5-13db-4f29-bd8f-1e612c069179'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.705664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41826fb666484cc995bffeb84133f348', 'request_id': 'req-22d69bc5-13db-4f29-bd8f-1e612c069179'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.719771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] The token cache is being invalidate because project 41826fb666484cc995bffeb84133f348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:32.720063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.720735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-22d69bc5-13db-4f29-bd8f-1e612c069179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:32.722251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1086/2163] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:32 2022] DELETE /identity/v3/projects/41826fb666484cc995bffeb84133f348 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:32.727871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b2c3-84dc-4ab4-aeff-38d95bd4b5f5 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:32.728165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b2c3-84dc-4ab4-aeff-38d95bd4b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:32.728478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b2c3-84dc-4ab4-aeff-38d95bd4b5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:32.747706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3d98b2c3-84dc-4ab4-aeff-38d95bd4b5f5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:32.748913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3d98b2c3-84dc-4ab4-aeff-38d95bd4b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:32.806626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1078/2164] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:32.814319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6e990-00fa-4567-98f0-b4ee0b64232e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:32.814611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6e990-00fa-4567-98f0-b4ee0b64232e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:32.814890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6e990-00fa-4567-98f0-b4ee0b64232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:32.834633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8da6e990-00fa-4567-98f0-b4ee0b64232e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:32.835890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8da6e990-00fa-4567-98f0-b4ee0b64232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:32.846578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1087/2165] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:32.848419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98b2c3-84dc-4ab4-aeff-38d95bd4b5f5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:32.859761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98b2c3-84dc-4ab4-aeff-38d95bd4b5f5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:32.864429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:32.865021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:32.865327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:32.865658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:32.866347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:32.866678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:32.868324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:32.879994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1079/2166] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:30:32.884911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6e990-00fa-4567-98f0-b4ee0b64232e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:32.894546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6e990-00fa-4567-98f0-b4ee0b64232e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:32.899877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8cb83-37bd-41de-bb0b-d6e922c2955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:32.900469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8cb83-37bd-41de-bb0b-d6e922c2955d admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:32.900750 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8cb83-37bd-41de-bb0b-d6e922c2955d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:32.901025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8cb83-37bd-41de-bb0b-d6e922c2955d admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:32.901655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8cb83-37bd-41de-bb0b-d6e922c2955d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:32.903586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8cb83-37bd-41de-bb0b-d6e922c2955d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:32.930416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1088/2167] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:32 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:32.934523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:32.945178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a2202-52ca-40f0-96fc-5c7b69b77bfe admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:33.005590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab064b77-28f7-426b-992b-9d577e6c215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:33.006716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab064b77-28f7-426b-992b-9d577e6c215d admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:33.006978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab064b77-28f7-426b-992b-9d577e6c215d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:33.007245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab064b77-28f7-426b-992b-9d577e6c215d admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:33.007865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab064b77-28f7-426b-992b-9d577e6c215d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:33.009777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab064b77-28f7-426b-992b-9d577e6c215d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:33.030854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1080/2168] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:32 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:33.034997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8cb83-37bd-41de-bb0b-d6e922c2955d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:33.045371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8cb83-37bd-41de-bb0b-d6e922c2955d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:33.055896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a8fcb-3abb-45bd-a3cb-c09a36a093b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:33.056693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a8fcb-3abb-45bd-a3cb-c09a36a093b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:33.056976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a8fcb-3abb-45bd-a3cb-c09a36a093b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:33.057248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a8fcb-3abb-45bd-a3cb-c09a36a093b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:33.057925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a8fcb-3abb-45bd-a3cb-c09a36a093b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:33.059597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a8fcb-3abb-45bd-a3cb-c09a36a093b1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:33.070420 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1089/2169] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:33.074379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab064b77-28f7-426b-992b-9d577e6c215d admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:33.085124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab064b77-28f7-426b-992b-9d577e6c215d admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:33.090021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a59d0-abf1-4d7a-8b35-33a5da0ade75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:33.090663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a59d0-abf1-4d7a-8b35-33a5da0ade75 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:33.090975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a59d0-abf1-4d7a-8b35-33a5da0ade75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:33.091260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a59d0-abf1-4d7a-8b35-33a5da0ade75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:33.091904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a59d0-abf1-4d7a-8b35-33a5da0ade75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:33.093532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a59d0-abf1-4d7a-8b35-33a5da0ade75 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:33.105165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1081/2170] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:33.109379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a8fcb-3abb-45bd-a3cb-c09a36a093b1 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:33.119369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a8fcb-3abb-45bd-a3cb-c09a36a093b1 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:33.123972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:33.124616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:33.124895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:33.125170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] PATH_INFO: `/v3/projects/411ff5503fa2407fb61d090d73993145/users/b4ae655aa3694f3486fd64ee52d5e5ef/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:33.128127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:33.141505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411ff5503fa2407fb61d090d73993145, user_id=b4ae655aa3694f3486fd64ee52d5e5ef, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:33.144567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:33.158157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1090/2171] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:33 2022] PUT /identity/v3/projects/411ff5503fa2407fb61d090d73993145/users/b4ae655aa3694f3486fd64ee52d5e5ef/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:33.169619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1a07c-1e69-4f5c-b1f8-fd834181202c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:33.169906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1a07c-1e69-4f5c-b1f8-fd834181202c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:33.170217 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1a07c-1e69-4f5c-b1f8-fd834181202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:33.197194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7fb1a07c-1e69-4f5c-b1f8-fd834181202c None None] MFA Rules not processed for user `b4ae655aa3694f3486fd64ee52d5e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:33.198380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7fb1a07c-1e69-4f5c-b1f8-fd834181202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:33.234419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:33.264671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1082/2172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:33.276300 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:33.277981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:33.333893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a799f-134f-4b28-8e15-050453b420a4 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:33.337636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d5fb05964b47d5a2f33fe9dde1f65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:33.338264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:33.338571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:33.338843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:33.346879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:33.348283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:33.356731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1091/2173] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:39.106901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebf61d-f715-4fdd-a08e-2e794f710779 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:39.107397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebf61d-f715-4fdd-a08e-2e794f710779 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:39.107484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebf61d-f715-4fdd-a08e-2e794f710779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:39.129036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-5cebf61d-f715-4fdd-a08e-2e794f710779 None None] MFA Rules not processed for user `d96cd2348dc14beeb6fafe55db57c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:39.130429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5cebf61d-f715-4fdd-a08e-2e794f710779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:39.187945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1083/2174] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:43.352920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:49.181371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=35 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:53.963756 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:53.965182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:54.040138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc21c6-8d5b-4b50-a349-0a96c5c32315 service glance] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:54.044721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:54.045347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:54.045628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:54.045956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] PATH_INFO: `/v3/users/f997129b88604f4c805f79832166f24b` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:54.047062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f997129b88604f4c805f79832166f24b)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:54.048973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:54.107676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f997129b88604f4c805f79832166f24b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.119053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f997129b88604f4c805f79832166f24b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.120707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f997129b88604f4c805f79832166f24b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.120707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f997129b88604f4c805f79832166f24b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.139015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f997129b88604f4c805f79832166f24b'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.153462 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1092/2175] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:30:53 2022] DELETE /identity/v3/users/f997129b88604f4c805f79832166f24b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:54.157931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9a86-ea44-4491-94ad-8b80eeca90de None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:54.158458 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9a86-ea44-4491-94ad-8b80eeca90de None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:54.158595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9a86-ea44-4491-94ad-8b80eeca90de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:54.179392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-870e9a86-ea44-4491-94ad-8b80eeca90de None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:54.180620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-870e9a86-ea44-4491-94ad-8b80eeca90de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:54.244635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1084/2176] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:54.254815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:54.257273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:54.323105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f763e-d573-4b94-824e-a1c4c90b446a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:54.326908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362577-3fa6-4ab9-b227-7fb5ebd6b17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:54.327691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362577-3fa6-4ab9-b227-7fb5ebd6b17a service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:54.327980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362577-3fa6-4ab9-b227-7fb5ebd6b17a service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:54.328249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362577-3fa6-4ab9-b227-7fb5ebd6b17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:54.338801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362577-3fa6-4ab9-b227-7fb5ebd6b17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:54.340258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362577-3fa6-4ab9-b227-7fb5ebd6b17a service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:54.351356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1093/2177] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:30:54.667153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9a86-ea44-4491-94ad-8b80eeca90de None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:54.668618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-870e9a86-ea44-4491-94ad-8b80eeca90de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:54.681321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9a86-ea44-4491-94ad-8b80eeca90de None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:54.686331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:54.687093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:54.687828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:54.687828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] PATH_INFO: `/v3/projects/d11e464dfd504186a1dfbf42799bf0f3` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:54.689061 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11e464dfd504186a1dfbf42799bf0f3)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:54.691177 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:54.759733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11e464dfd504186a1dfbf42799bf0f3', 'request_id': 'req-15237dc6-c8b1-4209-83e7-facc6805f955'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.773689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11e464dfd504186a1dfbf42799bf0f3', 'request_id': 'req-15237dc6-c8b1-4209-83e7-facc6805f955'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.780440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11e464dfd504186a1dfbf42799bf0f3', 'request_id': 'req-15237dc6-c8b1-4209-83e7-facc6805f955'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.795056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] The token cache is being invalidate because project d11e464dfd504186a1dfbf42799bf0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:30:54.795358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.796040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-15237dc6-c8b1-4209-83e7-facc6805f955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:30:54.798397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1085/2178] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:30:54 2022] DELETE /identity/v3/projects/d11e464dfd504186a1dfbf42799bf0f3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:54.807619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dbf8f-2a64-4974-ae72-60c621cdeeaa None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:54.807775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dbf8f-2a64-4974-ae72-60c621cdeeaa None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:54.808171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dbf8f-2a64-4974-ae72-60c621cdeeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:54.841257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b34dbf8f-2a64-4974-ae72-60c621cdeeaa None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:54.842766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b34dbf8f-2a64-4974-ae72-60c621cdeeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:54.870452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:54.918365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1094/2179] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:54.926731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e1cd7-6aaf-4611-b713-73bc0923758c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:54.927023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e1cd7-6aaf-4611-b713-73bc0923758c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:54.927306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e1cd7-6aaf-4611-b713-73bc0923758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:54.949576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-930e1cd7-6aaf-4611-b713-73bc0923758c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:54.950864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-930e1cd7-6aaf-4611-b713-73bc0923758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:54.964012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1086/2180] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:54.965225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dbf8f-2a64-4974-ae72-60c621cdeeaa None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:54.975239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dbf8f-2a64-4974-ae72-60c621cdeeaa None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:54.980248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:54.980865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:54.981148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:54.981422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:54.982093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:30:54.982418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:54.984023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:54.997019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1095/2181] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:30:55.001452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e1cd7-6aaf-4611-b713-73bc0923758c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:55.016117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e1cd7-6aaf-4611-b713-73bc0923758c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:55.021283 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c86f1-1236-4eac-a9cf-fe1958db185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:55.022362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c86f1-1236-4eac-a9cf-fe1958db185e admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:55.022646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c86f1-1236-4eac-a9cf-fe1958db185e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:55.022919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c86f1-1236-4eac-a9cf-fe1958db185e admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:55.023711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c86f1-1236-4eac-a9cf-fe1958db185e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:55.029203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c86f1-1236-4eac-a9cf-fe1958db185e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:55.068622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1087/2182] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:30:55 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:30:55.073328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:55.083940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699748c-8410-4f38-8d78-8487bdb960a3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:55.143683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd7be5-8c4c-4701-ab43-5df7d4b18cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:55.144446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd7be5-8c4c-4701-ab43-5df7d4b18cee admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:55.145081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd7be5-8c4c-4701-ab43-5df7d4b18cee admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:55.145758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd7be5-8c4c-4701-ab43-5df7d4b18cee admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:55.145989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd7be5-8c4c-4701-ab43-5df7d4b18cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:55.149807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd7be5-8c4c-4701-ab43-5df7d4b18cee admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:55.172277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1096/2183] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:30:55 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:30:55.176495 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c86f1-1236-4eac-a9cf-fe1958db185e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:55.187877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c86f1-1236-4eac-a9cf-fe1958db185e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:55.193082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f020-f0fb-49b1-8136-5c0fb5d438e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:55.193691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f020-f0fb-49b1-8136-5c0fb5d438e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:55.194610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f020-f0fb-49b1-8136-5c0fb5d438e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:55.194892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f020-f0fb-49b1-8136-5c0fb5d438e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:55.195550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42f020-f0fb-49b1-8136-5c0fb5d438e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:55.197175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42f020-f0fb-49b1-8136-5c0fb5d438e8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:55.208049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1088/2184] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:55.212208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd7be5-8c4c-4701-ab43-5df7d4b18cee admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:55.222980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd7be5-8c4c-4701-ab43-5df7d4b18cee admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:55.227767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09582201-38a3-4dba-bc3a-5ffb38e8b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:55.228371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09582201-38a3-4dba-bc3a-5ffb38e8b8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:55.228652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09582201-38a3-4dba-bc3a-5ffb38e8b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:55.228923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09582201-38a3-4dba-bc3a-5ffb38e8b8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:55.229565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09582201-38a3-4dba-bc3a-5ffb38e8b8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:55.231209 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09582201-38a3-4dba-bc3a-5ffb38e8b8c6 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:55.243315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1097/2185] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:30:55.247261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f020-f0fb-49b1-8136-5c0fb5d438e8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:55.258584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f020-f0fb-49b1-8136-5c0fb5d438e8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:55.263432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:55.264127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:55.264408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:55.264682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] PATH_INFO: `/v3/projects/31ec18a1045744aeb65fa2ff222b3278/users/231fc7f7d30f4d749e94cfb32806ec98/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:55.279961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ec18a1045744aeb65fa2ff222b3278, user_id=231fc7f7d30f4d749e94cfb32806ec98, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:55.282660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:55.296225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1089/2186] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:30:55 2022] PUT /identity/v3/projects/31ec18a1045744aeb65fa2ff222b3278/users/231fc7f7d30f4d749e94cfb32806ec98/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:30:55.301212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876912e-5c20-4a14-ab9d-35bd578fa8b9 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:55.301504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876912e-5c20-4a14-ab9d-35bd578fa8b9 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:55.301779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876912e-5c20-4a14-ab9d-35bd578fa8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:55.323911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8876912e-5c20-4a14-ab9d-35bd578fa8b9 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:55.325058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8876912e-5c20-4a14-ab9d-35bd578fa8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:55.395710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1098/2187] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:55.412246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:55.414689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:55.438392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:55.477466 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09f20f-8ccf-44ff-b7a9-d3afeb95c39e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:55.481802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:55.482520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:55.482877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:55.483275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:55.493588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:55.495063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:55.505391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1090/2188] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:56.150802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb972793-6770-465e-a555-cc7ac5517602 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:56.151332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb972793-6770-465e-a555-cc7ac5517602 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:56.151595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb972793-6770-465e-a555-cc7ac5517602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:56.181002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-fb972793-6770-465e-a555-cc7ac5517602 None None] MFA Rules not processed for user `231fc7f7d30f4d749e94cfb32806ec98`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:56.182355 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fb972793-6770-465e-a555-cc7ac5517602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:56.199435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:56.249276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1099/2189] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:30:56.260101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:30:56.261618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:56.319827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135177-35b0-46b3-a9f0-d58446f2d2eb service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:30:56.323611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:30:56.324334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:56.324623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:56.324899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:56.333381 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:30:56.334928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:30:56.343622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1091/2190] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:30:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:30:57.692530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422087-1725-44b9-b58c-d199adeb8d23 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:30:57.693051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422087-1725-44b9-b58c-d199adeb8d23 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:30:57.693051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422087-1725-44b9-b58c-d199adeb8d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:30:57.712502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ad422087-1725-44b9-b58c-d199adeb8d23 None None] MFA Rules not processed for user `231fc7f7d30f4d749e94cfb32806ec98`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:30:57.713989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ad422087-1725-44b9-b58c-d199adeb8d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:30:57.720668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1100/2191] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:30:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:06.339638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=43 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:31:07.706800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=22 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:31:11.964552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:11.965940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:11.979401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0108e-f335-4add-a3bb-203b4d6808b4 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:11.983884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:11.984490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:11.984768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:11.985040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] PATH_INFO: `/v3/users/b4ae655aa3694f3486fd64ee52d5e5ef` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:11.986170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ae655aa3694f3486fd64ee52d5e5ef)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:11.988081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:12.034562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ae655aa3694f3486fd64ee52d5e5ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.041943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ae655aa3694f3486fd64ee52d5e5ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.042637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ae655aa3694f3486fd64ee52d5e5ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.050628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ae655aa3694f3486fd64ee52d5e5ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.063206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ae655aa3694f3486fd64ee52d5e5ef'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.069471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1092/2192] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:31:11 2022] DELETE /identity/v3/users/b4ae655aa3694f3486fd64ee52d5e5ef => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:31:12.074630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2e6c-5b33-4f53-b172-8aebe6f0c87a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.075182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2e6c-5b33-4f53-b172-8aebe6f0c87a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.075182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2e6c-5b33-4f53-b172-8aebe6f0c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.095212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c2ce2e6c-5b33-4f53-b172-8aebe6f0c87a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:12.096427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c2ce2e6c-5b33-4f53-b172-8aebe6f0c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:12.160264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1101/2193] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:12.169980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:12.171723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:12.230277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18b2ee-9cc8-4c98-9535-f176b3ffb634 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:12.233958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fafcc-7375-4fb7-87b7-ac82d3095889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:12.234605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fafcc-7375-4fb7-87b7-ac82d3095889 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.234889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fafcc-7375-4fb7-87b7-ac82d3095889 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.235164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fafcc-7375-4fb7-87b7-ac82d3095889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.244722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fafcc-7375-4fb7-87b7-ac82d3095889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:12.246208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fafcc-7375-4fb7-87b7-ac82d3095889 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:12.258888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1093/2194] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:31:12.531758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce2e6c-5b33-4f53-b172-8aebe6f0c87a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:12.533256 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c2ce2e6c-5b33-4f53-b172-8aebe6f0c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:12.548576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce2e6c-5b33-4f53-b172-8aebe6f0c87a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:12.554797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:12.555692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.556086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.556392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] PATH_INFO: `/v3/projects/411ff5503fa2407fb61d090d73993145` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.557601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411ff5503fa2407fb61d090d73993145)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:12.559546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:12.609417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411ff5503fa2407fb61d090d73993145', 'request_id': 'req-59c40f38-1976-4a2e-a802-f5c2626a8227'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.614733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411ff5503fa2407fb61d090d73993145', 'request_id': 'req-59c40f38-1976-4a2e-a802-f5c2626a8227'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.620796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411ff5503fa2407fb61d090d73993145', 'request_id': 'req-59c40f38-1976-4a2e-a802-f5c2626a8227'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.634032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] The token cache is being invalidate because project 411ff5503fa2407fb61d090d73993145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:31:12.634365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.635014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-59c40f38-1976-4a2e-a802-f5c2626a8227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:31:12.636513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1102/2195] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:31:12 2022] DELETE /identity/v3/projects/411ff5503fa2407fb61d090d73993145 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:31:12.641510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cfcad-066a-4924-8357-4e46770bf7fe None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.641799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cfcad-066a-4924-8357-4e46770bf7fe None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.642088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cfcad-066a-4924-8357-4e46770bf7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.662182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d85cfcad-066a-4924-8357-4e46770bf7fe None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:12.663389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d85cfcad-066a-4924-8357-4e46770bf7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:12.731455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1094/2196] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:12.739345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864713-7533-471d-b232-b1bc28bbc43b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.739632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864713-7533-471d-b232-b1bc28bbc43b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.739911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864713-7533-471d-b232-b1bc28bbc43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.759767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9a864713-7533-471d-b232-b1bc28bbc43b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:12.760972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9a864713-7533-471d-b232-b1bc28bbc43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:12.769053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1103/2197] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:12.773928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cfcad-066a-4924-8357-4e46770bf7fe None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:12.784332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cfcad-066a-4924-8357-4e46770bf7fe None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:12.788958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:12.789556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.789831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.790130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.790777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:31:12.791179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:12.792767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:12.804306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1095/2198] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:31:12.808671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864713-7533-471d-b232-b1bc28bbc43b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:12.817878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864713-7533-471d-b232-b1bc28bbc43b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:12.823226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25232d-5643-47b0-a4c7-1fddd10f31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:12.823842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25232d-5643-47b0-a4c7-1fddd10f31fd admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.824124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25232d-5643-47b0-a4c7-1fddd10f31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.824400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25232d-5643-47b0-a4c7-1fddd10f31fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.825035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25232d-5643-47b0-a4c7-1fddd10f31fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:12.826989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25232d-5643-47b0-a4c7-1fddd10f31fd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:12.860090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1104/2199] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:31:12 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:31:12.860894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:12.866370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:31:12.872203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664699cc-8464-4844-a4b7-d2c0db6afcce admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:12.929150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc943fb-401f-4e97-b0c0-d1ab9dd5cd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:12.930341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc943fb-401f-4e97-b0c0-d1ab9dd5cd7d admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.930624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc943fb-401f-4e97-b0c0-d1ab9dd5cd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.930899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc943fb-401f-4e97-b0c0-d1ab9dd5cd7d admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.931521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc943fb-401f-4e97-b0c0-d1ab9dd5cd7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:12.933438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc943fb-401f-4e97-b0c0-d1ab9dd5cd7d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:12.953017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1096/2200] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:31:12 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:31:12.957116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25232d-5643-47b0-a4c7-1fddd10f31fd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:12.968116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25232d-5643-47b0-a4c7-1fddd10f31fd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:12.972861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c8536-964e-4f7e-ae39-d64d9337e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:12.973498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c8536-964e-4f7e-ae39-d64d9337e704 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:12.973781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c8536-964e-4f7e-ae39-d64d9337e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:12.974056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c8536-964e-4f7e-ae39-d64d9337e704 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:12.974733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c8536-964e-4f7e-ae39-d64d9337e704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:12.976440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c8536-964e-4f7e-ae39-d64d9337e704 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:12.986994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1105/2201] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:31:12.991108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc943fb-401f-4e97-b0c0-d1ab9dd5cd7d admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:13.001711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc943fb-401f-4e97-b0c0-d1ab9dd5cd7d admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:13.006997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11712f-feb1-49fa-a6ad-08e244a65019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:13.007707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11712f-feb1-49fa-a6ad-08e244a65019 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:13.008138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11712f-feb1-49fa-a6ad-08e244a65019 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:13.008421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11712f-feb1-49fa-a6ad-08e244a65019 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:13.009074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11712f-feb1-49fa-a6ad-08e244a65019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:13.010730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11712f-feb1-49fa-a6ad-08e244a65019 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:13.022225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1097/2202] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:31:13.027018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c8536-964e-4f7e-ae39-d64d9337e704 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:13.036963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c8536-964e-4f7e-ae39-d64d9337e704 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:13.042246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:13.043313 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:13.043594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:13.044040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] PATH_INFO: `/v3/projects/9199eab313d04526840a59f1de2cdeb3/users/aa1b7491f8c14298a959ff9c96394a99/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:13.062000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9199eab313d04526840a59f1de2cdeb3, user_id=aa1b7491f8c14298a959ff9c96394a99, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:13.064912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:13.080658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1106/2203] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:31:13 2022] PUT /identity/v3/projects/9199eab313d04526840a59f1de2cdeb3/users/aa1b7491f8c14298a959ff9c96394a99/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:31:13.085954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba03d95-d228-4abd-9385-ce3f1ee1dd55 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:13.086420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba03d95-d228-4abd-9385-ce3f1ee1dd55 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:13.086831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba03d95-d228-4abd-9385-ce3f1ee1dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:13.106108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8ba03d95-d228-4abd-9385-ce3f1ee1dd55 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:13.107311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8ba03d95-d228-4abd-9385-ce3f1ee1dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:13.166467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1098/2204] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:13.178850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:13.178850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:13.201272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:31:13.237828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f055a-c353-4043-b01d-7a2c61d5e364 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:13.241445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae2c7-645e-4f68-be9c-d42be3820fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:13.242593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae2c7-645e-4f68-be9c-d42be3820fff service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:13.242868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae2c7-645e-4f68-be9c-d42be3820fff service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:13.243135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae2c7-645e-4f68-be9c-d42be3820fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:13.251807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae2c7-645e-4f68-be9c-d42be3820fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:13.253218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae2c7-645e-4f68-be9c-d42be3820fff service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:13.264888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1107/2205] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:31:17.253630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22a6e-68ca-4626-a8c2-2cd5f74402a0 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:17.254265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22a6e-68ca-4626-a8c2-2cd5f74402a0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:17.254265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22a6e-68ca-4626-a8c2-2cd5f74402a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:17.292823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a0b22a6e-68ca-4626-a8c2-2cd5f74402a0 None None] MFA Rules not processed for user `aa1b7491f8c14298a959ff9c96394a99`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:17.294111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a0b22a6e-68ca-4626-a8c2-2cd5f74402a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:17.367051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1099/2206] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:31:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:17.375279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae2c7-645e-4f68-be9c-d42be3820fff service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:17.385988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae2c7-645e-4f68-be9c-d42be3820fff service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:17.392056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dda18-cee4-452e-a4cd-03aeadd24f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:17.392712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dda18-cee4-452e-a4cd-03aeadd24f30 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:17.393203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dda18-cee4-452e-a4cd-03aeadd24f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:17.393737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dda18-cee4-452e-a4cd-03aeadd24f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:17.394556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dda18-cee4-452e-a4cd-03aeadd24f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:17.396478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dda18-cee4-452e-a4cd-03aeadd24f30 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:17.425867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1108/2207] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:31:17 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:31:17.430719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22a6e-68ca-4626-a8c2-2cd5f74402a0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:17.447505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22a6e-68ca-4626-a8c2-2cd5f74402a0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:17.455718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:31:17.510196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cd43d-1b95-48f7-8909-8824eb127540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:17.510886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cd43d-1b95-48f7-8909-8824eb127540 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:17.511172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cd43d-1b95-48f7-8909-8824eb127540 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:17.511561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cd43d-1b95-48f7-8909-8824eb127540 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:17.512199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cd43d-1b95-48f7-8909-8824eb127540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:17.514081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cd43d-1b95-48f7-8909-8824eb127540 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:17.542407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1100/2208] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:31:17 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:31:17.546650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dda18-cee4-452e-a4cd-03aeadd24f30 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:17.576532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dda18-cee4-452e-a4cd-03aeadd24f30 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:17.586286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f913f-cbaa-408f-84fb-6199ebf25260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:17.587330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f913f-cbaa-408f-84fb-6199ebf25260 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:17.588019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f913f-cbaa-408f-84fb-6199ebf25260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:17.588462 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f913f-cbaa-408f-84fb-6199ebf25260 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:17.589460 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f913f-cbaa-408f-84fb-6199ebf25260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:17.591433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f913f-cbaa-408f-84fb-6199ebf25260 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:17.605894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1109/2209] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:31:17.611821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cd43d-1b95-48f7-8909-8824eb127540 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:17.632734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cd43d-1b95-48f7-8909-8824eb127540 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:17.639791 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea082c-2691-4822-9fda-fdeaf54299ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:17.640499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea082c-2691-4822-9fda-fdeaf54299ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:17.640783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea082c-2691-4822-9fda-fdeaf54299ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:17.641056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea082c-2691-4822-9fda-fdeaf54299ae admin admin] PATH_INFO: `/v3/projects/7aac2bc94668403496274bf781fc3aab/users/1251640af89c43b7a157614bea746165/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:17.664313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea082c-2691-4822-9fda-fdeaf54299ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aac2bc94668403496274bf781fc3aab, user_id=1251640af89c43b7a157614bea746165, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:17.666800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea082c-2691-4822-9fda-fdeaf54299ae admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:17.684800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1101/2210] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:31:17 2022] PUT /identity/v3/projects/7aac2bc94668403496274bf781fc3aab/users/1251640af89c43b7a157614bea746165/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:31:17.688719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f913f-cbaa-408f-84fb-6199ebf25260 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:17.708891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f913f-cbaa-408f-84fb-6199ebf25260 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:17.781663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5b84b-b948-455c-9d83-12679c261eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:17.782557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b84b-b948-455c-9d83-12679c261eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:17.782934 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b84b-b948-455c-9d83-12679c261eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:17.783307 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b84b-b948-455c-9d83-12679c261eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:17.784061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5b84b-b948-455c-9d83-12679c261eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:17.786055 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5b84b-b948-455c-9d83-12679c261eb6 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:17.798616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1110/2211] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:31:17.802938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea082c-2691-4822-9fda-fdeaf54299ae admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:17.815434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea082c-2691-4822-9fda-fdeaf54299ae admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:17.820913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:17.821587 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:17.821868 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:17.822181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] PATH_INFO: `/v3/projects/7aac2bc94668403496274bf781fc3aab/users/1251640af89c43b7a157614bea746165/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:17.824141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aac2bc94668403496274bf781fc3aab, user_id=1251640af89c43b7a157614bea746165, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:17.826914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:17.839035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1102/2212] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:31:17 2022] PUT /identity/v3/projects/7aac2bc94668403496274bf781fc3aab/users/1251640af89c43b7a157614bea746165/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:31:22.549572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd093ce-6d9f-4aa1-a5af-1e0adf3804db None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:22.550092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd093ce-6d9f-4aa1-a5af-1e0adf3804db None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:22.550383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd093ce-6d9f-4aa1-a5af-1e0adf3804db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:22.588369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-cbd093ce-6d9f-4aa1-a5af-1e0adf3804db None None] MFA Rules not processed for user `1251640af89c43b7a157614bea746165`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:22.590277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cbd093ce-6d9f-4aa1-a5af-1e0adf3804db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:22.714119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1111/2213] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:31:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:22.723146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:22.729721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:22.811748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d0af-6e5a-4e2b-828b-3c0d0ec806a5 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:22.817727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c5ff8-25f6-4610-96fc-ca21997db2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:22.818390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5ff8-25f6-4610-96fc-ca21997db2a2 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:22.818678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5ff8-25f6-4610-96fc-ca21997db2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:22.818956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5ff8-25f6-4610-96fc-ca21997db2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:22.880291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c5ff8-25f6-4610-96fc-ca21997db2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:22.881927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c5ff8-25f6-4610-96fc-ca21997db2a2 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:22.887210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:31:22.892830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1103/2214] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:31:23.933438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946123ef-b4c7-4f32-a3d7-cb8905ab44df None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:23.933925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946123ef-b4c7-4f32-a3d7-cb8905ab44df None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:23.934026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946123ef-b4c7-4f32-a3d7-cb8905ab44df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:23.958437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-946123ef-b4c7-4f32-a3d7-cb8905ab44df None None] MFA Rules not processed for user `aa1b7491f8c14298a959ff9c96394a99`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:23.959657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-946123ef-b4c7-4f32-a3d7-cb8905ab44df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:23.970316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1112/2215] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:31:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:33.952829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:31:36.992961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c1e8a-2e50-4c39-9bda-4c89d9afd4ad None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:36.993427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c1e8a-2e50-4c39-9bda-4c89d9afd4ad None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:36.993507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c1e8a-2e50-4c39-9bda-4c89d9afd4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:37.017006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-4b9c1e8a-2e50-4c39-9bda-4c89d9afd4ad None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:37.018512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4b9c1e8a-2e50-4c39-9bda-4c89d9afd4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:37.081567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1104/2216] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:37.122341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946123ef-b4c7-4f32-a3d7-cb8905ab44df None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:37.135162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946123ef-b4c7-4f32-a3d7-cb8905ab44df None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:37.140616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453109fa-50aa-4d87-9d03-8d6a17bc7b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:37.141218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453109fa-50aa-4d87-9d03-8d6a17bc7b58 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:37.141499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453109fa-50aa-4d87-9d03-8d6a17bc7b58 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:37.141770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453109fa-50aa-4d87-9d03-8d6a17bc7b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:37.150798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453109fa-50aa-4d87-9d03-8d6a17bc7b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:37.152382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453109fa-50aa-4d87-9d03-8d6a17bc7b58 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:37.163786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1113/2217] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:31:42.116261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e88c5-062f-464f-8344-6478398aea1d None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:42.116790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e88c5-062f-464f-8344-6478398aea1d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:42.116986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e88c5-062f-464f-8344-6478398aea1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:42.137392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-0d1e88c5-062f-464f-8344-6478398aea1d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:42.138671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0d1e88c5-062f-464f-8344-6478398aea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:42.146831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1105/2218] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:42.171164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453109fa-50aa-4d87-9d03-8d6a17bc7b58 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:42.183653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453109fa-50aa-4d87-9d03-8d6a17bc7b58 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:42.189395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:42.190033 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:42.190377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:42.190684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:42.200488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:42.202237 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:42.213265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1114/2219] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:31:47.687496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05d89c-3d17-4284-a786-7fe1b5c50b5c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:47.688072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05d89c-3d17-4284-a786-7fe1b5c50b5c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:47.688072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05d89c-3d17-4284-a786-7fe1b5c50b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:47.708639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-bc05d89c-3d17-4284-a786-7fe1b5c50b5c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:47.709856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-bc05d89c-3d17-4284-a786-7fe1b5c50b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:47.719924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1106/2220] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:47.741519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:47.743046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:47.758784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479f1e-bda9-4a8e-9326-6b1ac8734585 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:47.764463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:47.765069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:47.765353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:47.765628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:47.775268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:47.777800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:47.788426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1115/2221] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:31:50.077670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d343f-d060-4e05-8de6-2559194fd8c3 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:50.078152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d343f-d060-4e05-8de6-2559194fd8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:50.078256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d343f-d060-4e05-8de6-2559194fd8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:50.097344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-9a3d343f-d060-4e05-8de6-2559194fd8c3 None None] MFA Rules not processed for user `17cc8db0bbd24c4098931f2c53381751`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:50.098595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9a3d343f-d060-4e05-8de6-2559194fd8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:50.159356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1107/2222] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:31:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:50.545733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:50.547249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:50.620667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603eee0e-c624-49f4-96e9-1ec23bc39384 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:50.625884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:50.626604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:50.626965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:50.627306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:50.629134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:50.640761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:50.642481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:50.653178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1116/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:31:51.540842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069e05-c5f9-4b15-82ba-06c78665ecb4 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:51.541228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069e05-c5f9-4b15-82ba-06c78665ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:51.541388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069e05-c5f9-4b15-82ba-06c78665ecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:51.576574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d1069e05-c5f9-4b15-82ba-06c78665ecb4 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:51.577886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d1069e05-c5f9-4b15-82ba-06c78665ecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:51.586906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1108/2224] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:51.785173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:51.799876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47f322-a800-44e1-8a34-e49272a43e12 service placement] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:51.806652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617f8b3-7614-4d7d-9b82-83c513461e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:51.807409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f8b3-7614-4d7d-9b82-83c513461e8e service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:51.807832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f8b3-7614-4d7d-9b82-83c513461e8e service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:51.808184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f8b3-7614-4d7d-9b82-83c513461e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:51.819983 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617f8b3-7614-4d7d-9b82-83c513461e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:51.821668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617f8b3-7614-4d7d-9b82-83c513461e8e service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:51.833923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1117/2225] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:31:57.832866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea15f-911d-41e0-8201-5903fda2abf2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:57.833374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea15f-911d-41e0-8201-5903fda2abf2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:57.833456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea15f-911d-41e0-8201-5903fda2abf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:57.855072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-98cea15f-911d-41e0-8201-5903fda2abf2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:31:57.856584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-98cea15f-911d-41e0-8201-5903fda2abf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:31:57.865863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1109/2226] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:31:57.889917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617f8b3-7614-4d7d-9b82-83c513461e8e service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:31:57.904114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617f8b3-7614-4d7d-9b82-83c513461e8e service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:31:57.910739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:31:57.911458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:31:57.912037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:31:57.912381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:31:57.922574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:31:57.924282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:31:57.934824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1118/2227] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:32:07.849282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=64 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:07.929993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=62 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:08.996139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7bd6-272f-48ae-99ad-fb1ea826dbe9 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:08.996634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7bd6-272f-48ae-99ad-fb1ea826dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:08.996634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7bd6-272f-48ae-99ad-fb1ea826dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:09.015701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-80ea7bd6-272f-48ae-99ad-fb1ea826dbe9 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:32:09.016883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-80ea7bd6-272f-48ae-99ad-fb1ea826dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:09.070473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1110/2228] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:32:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:32:09.114052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:32:09.115487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:09.211187 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f349d4-eded-4837-9d14-5d73afa08517 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:32:09.217475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da0a7-a68f-45e6-959e-b960faeff420 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:32:09.218189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da0a7-a68f-45e6-959e-b960faeff420 service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:09.219543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da0a7-a68f-45e6-959e-b960faeff420 service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:09.219543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da0a7-a68f-45e6-959e-b960faeff420 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:09.226419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181494b-0091-4254-9a87-fb011788f22c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:09.226930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181494b-0091-4254-9a87-fb011788f22c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:09.227425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181494b-0091-4254-9a87-fb011788f22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:09.228704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344da0a7-a68f-45e6-959e-b960faeff420 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:32:09.230406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344da0a7-a68f-45e6-959e-b960faeff420 service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:32:09.249056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1119/2229] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:32:09.263641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b181494b-0091-4254-9a87-fb011788f22c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:32:09.266087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b181494b-0091-4254-9a87-fb011788f22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:09.277340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1111/2230] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:32:09.310530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da0a7-a68f-45e6-959e-b960faeff420 service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:32:09.341639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da0a7-a68f-45e6-959e-b960faeff420 service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:32:09.348231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27811132-a044-4752-94d1-5eb83f76deee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:32:09.348989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811132-a044-4752-94d1-5eb83f76deee service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:09.349270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811132-a044-4752-94d1-5eb83f76deee service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:09.349540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811132-a044-4752-94d1-5eb83f76deee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:09.364589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27811132-a044-4752-94d1-5eb83f76deee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:32:09.368170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27811132-a044-4752-94d1-5eb83f76deee service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:32:09.383153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1120/2231] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:32:10.100314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181494b-0091-4254-9a87-fb011788f22c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:32:10.196054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181494b-0091-4254-9a87-fb011788f22c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:32:10.208137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df571418-78e3-433b-9307-7e555119a2dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:32:10.208765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571418-78e3-433b-9307-7e555119a2dd service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:10.209053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571418-78e3-433b-9307-7e555119a2dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:10.209326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571418-78e3-433b-9307-7e555119a2dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:10.225255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df571418-78e3-433b-9307-7e555119a2dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:32:10.228711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df571418-78e3-433b-9307-7e555119a2dd service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:32:10.240566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1112/2232] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:32:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:32:19.375177 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=38 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:20.235485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=54 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:28.717808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcf93a-1615-41a1-9339-3c929af0b092 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:28.718466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcf93a-1615-41a1-9339-3c929af0b092 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:28.718466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcf93a-1615-41a1-9339-3c929af0b092 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:28.720018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1121/2233] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:32:28.726141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ed07-8112-40d3-b399-24fee220a5ac None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:28.726963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ed07-8112-40d3-b399-24fee220a5ac None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:28.726963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ed07-8112-40d3-b399-24fee220a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:28.750017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a3e7ed07-8112-40d3-b399-24fee220a5ac None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:32:28.751307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a3e7ed07-8112-40d3-b399-24fee220a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:28.761829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1113/2234] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:32:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:32:28.773453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcf93a-1615-41a1-9339-3c929af0b092 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:32:28.775639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5afcf93a-1615-41a1-9339-3c929af0b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:28.835993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcf93a-1615-41a1-9339-3c929af0b092 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:32:28.840184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fff7de-a226-4c5f-a7ac-d5166014b204 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d5fb05964b47d5a2f33fe9dde1f65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:32:28.840783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fff7de-a226-4c5f-a7ac-d5166014b204 service glance] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:28.841063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fff7de-a226-4c5f-a7ac-d5166014b204 service glance] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:28.841335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fff7de-a226-4c5f-a7ac-d5166014b204 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:28.853570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fff7de-a226-4c5f-a7ac-d5166014b204 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:32:28.854627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fff7de-a226-4c5f-a7ac-d5166014b204 service glance] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:32:28.865573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1122/2235] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:32:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:32:28.934683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dcbb-7369-499c-b1f1-8bee783f886b None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:28.934967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dcbb-7369-499c-b1f1-8bee783f886b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:28.935241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dcbb-7369-499c-b1f1-8bee783f886b None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:28.936597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1114/2236] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:32:28.941314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878760-137d-4c9b-b9b3-35a38db22a88 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:28.941604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878760-137d-4c9b-b9b3-35a38db22a88 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:28.941906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878760-137d-4c9b-b9b3-35a38db22a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:28.962149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b4878760-137d-4c9b-b9b3-35a38db22a88 None None] MFA Rules not processed for user `17a501a048ed4b6c8186bfd490ad1394`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:32:28.963417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b4878760-137d-4c9b-b9b3-35a38db22a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:28.970692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1123/2237] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:32:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:32:28.982709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2dcbb-7369-499c-b1f1-8bee783f886b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:32:28.994178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2dcbb-7369-499c-b1f1-8bee783f886b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:32:28.998349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d59eb1-5471-4714-9564-abbb28f1be81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:32:28.998660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59eb1-5471-4714-9564-abbb28f1be81 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:28.998944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59eb1-5471-4714-9564-abbb28f1be81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:28.999261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59eb1-5471-4714-9564-abbb28f1be81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:29.008260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d59eb1-5471-4714-9564-abbb28f1be81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:32:29.010241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d59eb1-5471-4714-9564-abbb28f1be81 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:32:29.019173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1115/2238] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:32:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:32:29.105990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b501c-730a-4753-bfc2-da5a5010bb94 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:29.106306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b501c-730a-4753-bfc2-da5a5010bb94 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:29.106585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b501c-730a-4753-bfc2-da5a5010bb94 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:29.107974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1124/2239] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:32:29.112819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cc991-c5ab-4c9a-acb3-80fc7caed321 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:29.113106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cc991-c5ab-4c9a-acb3-80fc7caed321 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:29.113382 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cc991-c5ab-4c9a-acb3-80fc7caed321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:29.132300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c74cc991-c5ab-4c9a-acb3-80fc7caed321 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:32:29.134017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c74cc991-c5ab-4c9a-acb3-80fc7caed321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:29.143639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1116/2240] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:32:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:32:29.154807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b501c-730a-4753-bfc2-da5a5010bb94 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:32:29.165866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b501c-730a-4753-bfc2-da5a5010bb94 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:32:29.169552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e396f-7636-4166-81b1-d93ebd40b63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:32:29.170161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e396f-7636-4166-81b1-d93ebd40b63c service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:29.170470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e396f-7636-4166-81b1-d93ebd40b63c service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:29.170763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e396f-7636-4166-81b1-d93ebd40b63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:29.180592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e396f-7636-4166-81b1-d93ebd40b63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:32:29.182018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e396f-7636-4166-81b1-d93ebd40b63c service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:32:29.192421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1125/2241] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:32:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:32:29.304514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a72e3d-6e5b-4700-893d-7f567cd6efaf None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:29.304887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a72e3d-6e5b-4700-893d-7f567cd6efaf None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:29.305254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a72e3d-6e5b-4700-893d-7f567cd6efaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:29.327775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-79a72e3d-6e5b-4700-893d-7f567cd6efaf None None] MFA Rules not processed for user `231fc7f7d30f4d749e94cfb32806ec98`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:32:29.329005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-79a72e3d-6e5b-4700-893d-7f567cd6efaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:29.392349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1117/2242] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:32:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:32:31.973206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d33d-f0ce-4e37-8289-10c67541cc81 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:31.973673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d33d-f0ce-4e37-8289-10c67541cc81 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:31.973764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d33d-f0ce-4e37-8289-10c67541cc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:31.994684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-aa15d33d-f0ce-4e37-8289-10c67541cc81 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:32:31.995910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-aa15d33d-f0ce-4e37-8289-10c67541cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:32:32.003250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1126/2243] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:32:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:32:32.016319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a72e3d-6e5b-4700-893d-7f567cd6efaf None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:32:32.028469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a72e3d-6e5b-4700-893d-7f567cd6efaf None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:32:32.033893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cf360-8230-4601-870f-61595bfb1705 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:32:32.034564 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf360-8230-4601-870f-61595bfb1705 service swift] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:32:32.034870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf360-8230-4601-870f-61595bfb1705 service swift] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:32:32.035106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf360-8230-4601-870f-61595bfb1705 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:32:32.043922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cf360-8230-4601-870f-61595bfb1705 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:32:32.045511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cf360-8230-4601-870f-61595bfb1705 service swift] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:32:32.054835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1118/2244] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:32:41.989445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=38 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:42.051577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=43 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:00.236440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2418f7-9941-4e89-9a1e-afa02e7911aa None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:00.236982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2418f7-9941-4e89-9a1e-afa02e7911aa None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:00.236982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2418f7-9941-4e89-9a1e-afa02e7911aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:00.259974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ca2418f7-9941-4e89-9a1e-afa02e7911aa None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:33:00.261180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ca2418f7-9941-4e89-9a1e-afa02e7911aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:00.268523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1127/2245] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 00:33:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:33:00.281888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cf360-8230-4601-870f-61595bfb1705 service swift] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:00.292995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cf360-8230-4601-870f-61595bfb1705 service swift] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:00.298407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc42-ead6-479b-a67d-c553d77ac396 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:00.299115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc42-ead6-479b-a67d-c553d77ac396 service swift] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:00.299467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc42-ead6-479b-a67d-c553d77ac396 service swift] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:00.299860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc42-ead6-479b-a67d-c553d77ac396 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:00.308447 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266dc42-ead6-479b-a67d-c553d77ac396 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:00.310182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266dc42-ead6-479b-a67d-c553d77ac396 service swift] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:00.318556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1119/2246] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:33:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:33:05.713952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa805e-6bc2-432e-99b7-2d47bd52bc6f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:05.714442 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa805e-6bc2-432e-99b7-2d47bd52bc6f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:05.714550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa805e-6bc2-432e-99b7-2d47bd52bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:05.734013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c0aa805e-6bc2-432e-99b7-2d47bd52bc6f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:33:05.735415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c0aa805e-6bc2-432e-99b7-2d47bd52bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:05.743178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1128/2247] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:33:05.769059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc42-ead6-479b-a67d-c553d77ac396 service swift] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:05.780943 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc42-ead6-479b-a67d-c553d77ac396 service swift] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:05.786294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e341b-9209-4fbc-856c-313444a34340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:05.786874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e341b-9209-4fbc-856c-313444a34340 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:05.787151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e341b-9209-4fbc-856c-313444a34340 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:05.787418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e341b-9209-4fbc-856c-313444a34340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:05.795748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e341b-9209-4fbc-856c-313444a34340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:05.797311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e341b-9209-4fbc-856c-313444a34340 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:05.806567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1120/2248] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:33:09.991270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeae10-b1f1-4bcf-8b84-d07b2a3e3365 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:09.991767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeae10-b1f1-4bcf-8b84-d07b2a3e3365 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:09.991767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeae10-b1f1-4bcf-8b84-d07b2a3e3365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:10.012702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-dfbeae10-b1f1-4bcf-8b84-d07b2a3e3365 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:33:10.013944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-dfbeae10-b1f1-4bcf-8b84-d07b2a3e3365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:10.021892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1129/2249] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:33:10.043346 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e341b-9209-4fbc-856c-313444a34340 service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:10.054821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e341b-9209-4fbc-856c-313444a34340 service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:10.061625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f491729-aabf-480b-904d-abfe7d7fb386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:10.062245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f491729-aabf-480b-904d-abfe7d7fb386 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:10.062524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f491729-aabf-480b-904d-abfe7d7fb386 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:10.062797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f491729-aabf-480b-904d-abfe7d7fb386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:10.071317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f491729-aabf-480b-904d-abfe7d7fb386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:10.073570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f491729-aabf-480b-904d-abfe7d7fb386 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:10.082773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1121/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:33:14.087378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8096fb-0e8f-486a-89fe-252deaa90fb2 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:14.087959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8096fb-0e8f-486a-89fe-252deaa90fb2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:14.087959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8096fb-0e8f-486a-89fe-252deaa90fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:14.107180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ec8096fb-0e8f-486a-89fe-252deaa90fb2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:33:14.108364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ec8096fb-0e8f-486a-89fe-252deaa90fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:14.115991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1130/2251] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:33:14.141774 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f491729-aabf-480b-904d-abfe7d7fb386 service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:14.153658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f491729-aabf-480b-904d-abfe7d7fb386 service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:14.159120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed3b62-c93a-4958-a053-b6ef52c44c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:14.159708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed3b62-c93a-4958-a053-b6ef52c44c4f service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:14.159985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed3b62-c93a-4958-a053-b6ef52c44c4f service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:14.160252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed3b62-c93a-4958-a053-b6ef52c44c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:14.168373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed3b62-c93a-4958-a053-b6ef52c44c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:14.169950 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed3b62-c93a-4958-a053-b6ef52c44c4f service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:14.179467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1122/2252] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:33:18.276208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3bc2e-2753-4fad-b681-e98f826ceeda None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:18.276707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3bc2e-2753-4fad-b681-e98f826ceeda None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:18.276805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3bc2e-2753-4fad-b681-e98f826ceeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:18.295619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-aec3bc2e-2753-4fad-b681-e98f826ceeda None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:33:18.297379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-aec3bc2e-2753-4fad-b681-e98f826ceeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:18.307054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1131/2253] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:33:18.336094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed3b62-c93a-4958-a053-b6ef52c44c4f service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:18.347145 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed3b62-c93a-4958-a053-b6ef52c44c4f service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:18.352547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec18d3-3df9-489f-b252-5ed520d9125f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:18.353130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec18d3-3df9-489f-b252-5ed520d9125f service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:18.353413 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec18d3-3df9-489f-b252-5ed520d9125f service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:18.353687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec18d3-3df9-489f-b252-5ed520d9125f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:18.361643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec18d3-3df9-489f-b252-5ed520d9125f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:18.363247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec18d3-3df9-489f-b252-5ed520d9125f service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:18.372939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1123/2254] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:33:22.521444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7b95-4787-40ad-a21f-5803cac828a5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:22.521982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7b95-4787-40ad-a21f-5803cac828a5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:22.521982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7b95-4787-40ad-a21f-5803cac828a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:22.529585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=16 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:22.541990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-3f2b7b95-4787-40ad-a21f-5803cac828a5 None None] MFA Rules not processed for user `d96cd2348dc14beeb6fafe55db57c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:33:22.543809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3f2b7b95-4787-40ad-a21f-5803cac828a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:22.596332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1132/2255] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:33:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:33:24.523532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df417-d27e-4e36-be30-da93339c3b81 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:24.524035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df417-d27e-4e36-be30-da93339c3b81 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:24.524128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df417-d27e-4e36-be30-da93339c3b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:24.534916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=31 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:24.547914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e76df417-d27e-4e36-be30-da93339c3b81 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:33:24.549290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e76df417-d27e-4e36-be30-da93339c3b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:24.557103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1124/2256] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 8 00:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:33:24.593945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b7b95-4787-40ad-a21f-5803cac828a5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:24.606517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b7b95-4787-40ad-a21f-5803cac828a5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:24.611998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ecd27-5bd8-4608-b034-d44d741bd868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:24.612605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ecd27-5bd8-4608-b034-d44d741bd868 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:24.612874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ecd27-5bd8-4608-b034-d44d741bd868 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:24.613172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ecd27-5bd8-4608-b034-d44d741bd868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:24.621286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ecd27-5bd8-4608-b034-d44d741bd868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:24.622914 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ecd27-5bd8-4608-b034-d44d741bd868 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:24.632320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1133/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:33:34.543302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:34.628039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=30 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:35.205344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76df417-d27e-4e36-be30-da93339c3b81 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:35.206906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e76df417-d27e-4e36-be30-da93339c3b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:35.220071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76df417-d27e-4e36-be30-da93339c3b81 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:35.223923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:35.224521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:35.224801 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:35.225079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:35.226855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:35.243285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:35.244832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:35.256517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1125/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:33:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:33:37.760490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ecd27-5bd8-4608-b034-d44d741bd868 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:37.770173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ecd27-5bd8-4608-b034-d44d741bd868 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:37.773848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:37.774719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:37.775096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:37.775441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:37.777759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:37.791602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:37.793696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:37.804722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1134/2259] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:33:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:33:45.251581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=6 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:47.799755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=6 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:59.354569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:33:59.365817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3452a-aad9-4b20-8a7e-04d2d58e4c41 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:33:59.371236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:33:59.371816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:33:59.372120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:33:59.372389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:33:59.374098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:33:59.384531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:33:59.386113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:33:59.395702 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1126/2260] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:33:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:02.435674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:02.437258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:02.454239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb72233-f443-40c2-a4fb-cf66e49ddbc8 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:02.459163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:02.459877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:02.460417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:02.460896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] PATH_INFO: `/v3/users/231fc7f7d30f4d749e94cfb32806ec98` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:02.462165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231fc7f7d30f4d749e94cfb32806ec98)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:02.464309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:02.523493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231fc7f7d30f4d749e94cfb32806ec98'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.532808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231fc7f7d30f4d749e94cfb32806ec98'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.533601 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231fc7f7d30f4d749e94cfb32806ec98'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.534311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231fc7f7d30f4d749e94cfb32806ec98'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.551291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231fc7f7d30f4d749e94cfb32806ec98'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.578501 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1135/2261] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:34:02 2022] DELETE /identity/v3/users/231fc7f7d30f4d749e94cfb32806ec98 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:34:02.774548 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:02.789570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23bd6-6e57-4577-974c-ea3810fdb691 service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:02.858294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:02.858991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:02.859298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:02.859577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] PATH_INFO: `/v3/projects/31ec18a1045744aeb65fa2ff222b3278` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:02.860735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ec18a1045744aeb65fa2ff222b3278)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:02.862840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:02.913354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ec18a1045744aeb65fa2ff222b3278', 'request_id': 'req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.919320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ec18a1045744aeb65fa2ff222b3278', 'request_id': 'req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.926248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ec18a1045744aeb65fa2ff222b3278', 'request_id': 'req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.941018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] The token cache is being invalidate because project 31ec18a1045744aeb65fa2ff222b3278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:34:02.941434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.942263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-14c8f7bc-1997-4b3a-9bd5-50a94b55186f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:34:02.943816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1127/2262] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:34:02 2022] DELETE /identity/v3/projects/31ec18a1045744aeb65fa2ff222b3278 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:34:09.554510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:09.556017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:09.636728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0294-6a21-4c87-97cf-672d99460534 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:09.710764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:09.711439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:09.711651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:09.711944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:09.714900 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:09.721739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:09.780168 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:09.781940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:09.793138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1136/2263] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:12.399473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb584-1544-450e-a5e5-cc0fd9d2bc72 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:12.399954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb584-1544-450e-a5e5-cc0fd9d2bc72 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:12.400074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb584-1544-450e-a5e5-cc0fd9d2bc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:12.429417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-604fb584-1544-450e-a5e5-cc0fd9d2bc72 None None] MFA Rules not processed for user `17cc8db0bbd24c4098931f2c53381751`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:34:12.430650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-604fb584-1544-450e-a5e5-cc0fd9d2bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:12.486890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1128/2264] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:34:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:34:13.038499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:13.039987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:13.096731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b14b7-f84b-4777-824b-6e0bb1ab09b9 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:13.100392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:13.101002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:13.101291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:13.101570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:13.103429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:13.114884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:13.116290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:13.124716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1137/2265] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:34:13.436910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fb584-1544-450e-a5e5-cc0fd9d2bc72 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:13.438311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-604fb584-1544-450e-a5e5-cc0fd9d2bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:13.465592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:13.510551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fb584-1544-450e-a5e5-cc0fd9d2bc72 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:13.515525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:13.516122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:13.516400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:13.516671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:13.518652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:13.529556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:13.531677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:13.541167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1129/2266] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:15.576725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:15.578876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:15.596373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaff8e4-7a84-4420-9365-b587f76dd7e3 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:15.602544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:15.603054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:15.603338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:15.603606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:15.605734 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:15.621285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:15.623716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:15.641011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1138/2267] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:15.734630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:15.736682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:15.758905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211bc8e-16ed-46f0-8772-2a46a827c9f8 service placement] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:15.773936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379189e6-d950-4885-bbda-675335036588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:15.774730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379189e6-d950-4885-bbda-675335036588 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:15.775090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379189e6-d950-4885-bbda-675335036588 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:15.775443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379189e6-d950-4885-bbda-675335036588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:15.778864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-379189e6-d950-4885-bbda-675335036588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:15.805936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379189e6-d950-4885-bbda-675335036588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:15.810410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379189e6-d950-4885-bbda-675335036588 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:15.823802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1130/2268] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:16.501052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:16.502593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:16.519382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09770b-8499-4bbb-82cb-ec47539b7218 service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:16.526537 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:16.527160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:16.527445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:16.527716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:16.529597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:16.548950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:16.551188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:16.564322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1139/2269] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:19.232983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b13dfd-95a0-4abb-840d-5fc8f90b0845 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:19.234103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b13dfd-95a0-4abb-840d-5fc8f90b0845 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:19.234103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b13dfd-95a0-4abb-840d-5fc8f90b0845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:19.253368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-98b13dfd-95a0-4abb-840d-5fc8f90b0845 None None] MFA Rules not processed for user `8c1dd80884d842669997cdb306ce0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:34:19.254581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-98b13dfd-95a0-4abb-840d-5fc8f90b0845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:19.261191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1131/2270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:34:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:34:24.221505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:24.238032 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41995b-4668-4e3b-9430-90224ae8873a service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:24.243891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:24.244629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:24.245008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:24.245412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:24.247271 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:24.266376 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:24.268036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:24.280338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1140/2271] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:29.247677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=31 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:34.276244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=68 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:36.230036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b13dfd-95a0-4abb-840d-5fc8f90b0845 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:36.231478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-98b13dfd-95a0-4abb-840d-5fc8f90b0845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:36.287053 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b13dfd-95a0-4abb-840d-5fc8f90b0845 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:36.290554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:36.291143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:36.291424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:36.291697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:36.293391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:36.351258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:36.352730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:36.362041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1132/2272] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:46.357612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=48 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:51.066876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:51.068260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:51.079450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7974cf-04bc-4560-8b50-b6c324509dbb service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:51.083677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c71d2a-826d-4875-bcfd-e080900fcb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:51.084260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71d2a-826d-4875-bcfd-e080900fcb2e service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:51.084539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71d2a-826d-4875-bcfd-e080900fcb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:51.084811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c71d2a-826d-4875-bcfd-e080900fcb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:51.086492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f2c71d2a-826d-4875-bcfd-e080900fcb2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:51.144122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c71d2a-826d-4875-bcfd-e080900fcb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:51.145472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c71d2a-826d-4875-bcfd-e080900fcb2e service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:51.154268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1141/2273] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:56.224515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:56.234635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394f358-dca9-4d5a-9726-49b1fb5e5f30 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:56.239277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:56.239899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:56.240178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:56.240448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:56.242323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:56.316889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:56.318516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:56.329402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1133/2274] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:34:58.288194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a06b35-8ee1-4af6-bf70-5adedd8a52de None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:58.288783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a06b35-8ee1-4af6-bf70-5adedd8a52de None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:58.288783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a06b35-8ee1-4af6-bf70-5adedd8a52de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:58.310628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-34a06b35-8ee1-4af6-bf70-5adedd8a52de None None] MFA Rules not processed for user `3e3151bac78942a69fb3764d5ef3814c`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:34:58.312018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-34a06b35-8ee1-4af6-bf70-5adedd8a52de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:58.323092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1142/2275] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:34:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:34:58.833625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:34:58.842608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981f3e5-35af-4625-b48d-744f98bb7ea7 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:34:58.846370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:34:58.846985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:34:58.847273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:34:58.847559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:34:58.849367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:34:58.865119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:34:58.866664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:34:58.874961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1134/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:34:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:00.084058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a06b35-8ee1-4af6-bf70-5adedd8a52de None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:00.085496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-34a06b35-8ee1-4af6-bf70-5adedd8a52de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:00.100651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a06b35-8ee1-4af6-bf70-5adedd8a52de None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:00.106680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:00.107311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.107594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.107868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] PATH_INFO: `/v3/users/d96cd2348dc14beeb6fafe55db57c13a` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.109021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96cd2348dc14beeb6fafe55db57c13a)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:00.111538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:00.160058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96cd2348dc14beeb6fafe55db57c13a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.167197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96cd2348dc14beeb6fafe55db57c13a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.167824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96cd2348dc14beeb6fafe55db57c13a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.168419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96cd2348dc14beeb6fafe55db57c13a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.180545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-cf5717c4-ef0b-497d-92f3-78cea1d707ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96cd2348dc14beeb6fafe55db57c13a'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.192841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1143/2277] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:00 2022] DELETE /identity/v3/users/d96cd2348dc14beeb6fafe55db57c13a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:00.370257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:00.391076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21e92e-3b09-41b6-8a09-538c1fa4fbac service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:00.469103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:00.469749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.470056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.470356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] PATH_INFO: `/v3/projects/6ffe0a1873fc4fb4a0e3924d16840e52` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.471404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffe0a1873fc4fb4a0e3924d16840e52)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:00.473436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:00.522128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffe0a1873fc4fb4a0e3924d16840e52', 'request_id': 'req-d332583b-91f0-4a6d-80a1-344728bec79b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.528037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffe0a1873fc4fb4a0e3924d16840e52', 'request_id': 'req-d332583b-91f0-4a6d-80a1-344728bec79b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.534979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffe0a1873fc4fb4a0e3924d16840e52', 'request_id': 'req-d332583b-91f0-4a6d-80a1-344728bec79b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.549269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] The token cache is being invalidate because project 6ffe0a1873fc4fb4a0e3924d16840e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:00.549563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.550238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d332583b-91f0-4a6d-80a1-344728bec79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:00.551819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1135/2278] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:00 2022] DELETE /identity/v3/projects/6ffe0a1873fc4fb4a0e3924d16840e52 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:00.556649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07332c1-6ceb-4ee9-a201-41fd8bb91b11 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.556957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07332c1-6ceb-4ee9-a201-41fd8bb91b11 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.557406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07332c1-6ceb-4ee9-a201-41fd8bb91b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.580842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e07332c1-6ceb-4ee9-a201-41fd8bb91b11 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:00.582321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e07332c1-6ceb-4ee9-a201-41fd8bb91b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:00.646051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1144/2279] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:00.653938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47895-a866-46d5-88a1-4414d6a3a5d1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.654260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47895-a866-46d5-88a1-4414d6a3a5d1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.654568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47895-a866-46d5-88a1-4414d6a3a5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.677939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b4e47895-a866-46d5-88a1-4414d6a3a5d1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:00.679178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b4e47895-a866-46d5-88a1-4414d6a3a5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:00.687146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1136/2280] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:00.691444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07332c1-6ceb-4ee9-a201-41fd8bb91b11 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:00.697381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:00.701452 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07332c1-6ceb-4ee9-a201-41fd8bb91b11 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:00.707567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:00.708373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.709078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.709369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.710035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:35:00.710389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:00.712022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:00.724284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1145/2281] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:35:00.728827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47895-a866-46d5-88a1-4414d6a3a5d1 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:00.734932 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:00.740186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47895-a866-46d5-88a1-4414d6a3a5d1 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:00.747412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831854f-c135-483f-8d7b-aee795120a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:00.748055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831854f-c135-483f-8d7b-aee795120a68 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.748361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831854f-c135-483f-8d7b-aee795120a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.748942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831854f-c135-483f-8d7b-aee795120a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.749200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831854f-c135-483f-8d7b-aee795120a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:00.751531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831854f-c135-483f-8d7b-aee795120a68 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:00.785384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1137/2282] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:00 2022] POST /identity/v3/projects => generated 357 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:00.789684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:00.800399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169bcde-a167-46ba-90bb-895741341d15 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:00.859553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cba6b-ba51-485a-8b6a-5c205f62c549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:00.860197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cba6b-ba51-485a-8b6a-5c205f62c549 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.860474 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cba6b-ba51-485a-8b6a-5c205f62c549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.861275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cba6b-ba51-485a-8b6a-5c205f62c549 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.861981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cba6b-ba51-485a-8b6a-5c205f62c549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:00.864242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cba6b-ba51-485a-8b6a-5c205f62c549 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:00.885767 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1146/2283] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:00 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:00.890030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831854f-c135-483f-8d7b-aee795120a68 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:00.902263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831854f-c135-483f-8d7b-aee795120a68 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:00.907143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ad82b-024b-4cb1-a97a-d512c21d258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:00.908431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ad82b-024b-4cb1-a97a-d512c21d258a admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.908709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ad82b-024b-4cb1-a97a-d512c21d258a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.908975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ad82b-024b-4cb1-a97a-d512c21d258a admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.909610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ad82b-024b-4cb1-a97a-d512c21d258a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:00.911229 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ad82b-024b-4cb1-a97a-d512c21d258a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:00.921367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1138/2284] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:00.925457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cba6b-ba51-485a-8b6a-5c205f62c549 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:00.935379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cba6b-ba51-485a-8b6a-5c205f62c549 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:00.939935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c07dd0-6d72-4f13-8577-7f8b28c28934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:00.940689 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07dd0-6d72-4f13-8577-7f8b28c28934 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.940974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07dd0-6d72-4f13-8577-7f8b28c28934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.941253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07dd0-6d72-4f13-8577-7f8b28c28934 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.941883 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c07dd0-6d72-4f13-8577-7f8b28c28934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:00.943499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c07dd0-6d72-4f13-8577-7f8b28c28934 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:00.954147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1147/2285] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:00.958665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ad82b-024b-4cb1-a97a-d512c21d258a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:00.968733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ad82b-024b-4cb1-a97a-d512c21d258a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:00.973984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea5010-c78c-4637-ba76-ae6e7dd60bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:00.974686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea5010-c78c-4637-ba76-ae6e7dd60bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:00.974967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea5010-c78c-4637-ba76-ae6e7dd60bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:00.975266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea5010-c78c-4637-ba76-ae6e7dd60bf0 admin admin] PATH_INFO: `/v3/projects/5014acbcd8a84ad4a65be80cbf8b806e/users/cda511afac704af8b7cdb66a44043468/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:00.990054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea5010-c78c-4637-ba76-ae6e7dd60bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5014acbcd8a84ad4a65be80cbf8b806e, user_id=cda511afac704af8b7cdb66a44043468, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:00.992853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea5010-c78c-4637-ba76-ae6e7dd60bf0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.009119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1139/2286] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:00 2022] PUT /identity/v3/projects/5014acbcd8a84ad4a65be80cbf8b806e/users/cda511afac704af8b7cdb66a44043468/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:01.019972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b89de-937b-44e9-8c6b-3fc834a6a30e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.020289 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b89de-937b-44e9-8c6b-3fc834a6a30e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.020568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b89de-937b-44e9-8c6b-3fc834a6a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.049006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f82b89de-937b-44e9-8c6b-3fc834a6a30e None None] MFA Rules not processed for user `cda511afac704af8b7cdb66a44043468`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:01.050247 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f82b89de-937b-44e9-8c6b-3fc834a6a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:01.114812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1148/2287] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:01.119275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea5010-c78c-4637-ba76-ae6e7dd60bf0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:01.180325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea5010-c78c-4637-ba76-ae6e7dd60bf0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:01.185012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c0bcc-ec10-4860-a7ab-72564b263d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:01.185624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c0bcc-ec10-4860-a7ab-72564b263d16 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.185912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c0bcc-ec10-4860-a7ab-72564b263d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.186184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c0bcc-ec10-4860-a7ab-72564b263d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.186816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c0bcc-ec10-4860-a7ab-72564b263d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:01.188818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c0bcc-ec10-4860-a7ab-72564b263d16 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.214678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1140/2288] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:01 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:01.218786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b89de-937b-44e9-8c6b-3fc834a6a30e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:01.230412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b89de-937b-44e9-8c6b-3fc834a6a30e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:01.286919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15dce-76de-47ca-a4aa-f3e68f3b98ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:01.287563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15dce-76de-47ca-a4aa-f3e68f3b98ed admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.287847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15dce-76de-47ca-a4aa-f3e68f3b98ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.288116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15dce-76de-47ca-a4aa-f3e68f3b98ed admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.288749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b15dce-76de-47ca-a4aa-f3e68f3b98ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:01.290827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b15dce-76de-47ca-a4aa-f3e68f3b98ed admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.299267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:01.316072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1149/2289] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:01 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:01.320570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c0bcc-ec10-4860-a7ab-72564b263d16 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:01.332138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c0bcc-ec10-4860-a7ab-72564b263d16 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:01.337669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8d9d-905d-499d-baaa-3700ea08de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:01.338298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8d9d-905d-499d-baaa-3700ea08de1e admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.338577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8d9d-905d-499d-baaa-3700ea08de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.338848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8d9d-905d-499d-baaa-3700ea08de1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.339490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b8d9d-905d-499d-baaa-3700ea08de1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:01.341120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b8d9d-905d-499d-baaa-3700ea08de1e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.351969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1141/2290] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:01.356156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15dce-76de-47ca-a4aa-f3e68f3b98ed admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:01.366360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15dce-76de-47ca-a4aa-f3e68f3b98ed admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:01.370943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f4b1-6945-4147-96d0-95680d9cf282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:01.371588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f4b1-6945-4147-96d0-95680d9cf282 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.371867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f4b1-6945-4147-96d0-95680d9cf282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.372191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f4b1-6945-4147-96d0-95680d9cf282 admin admin] PATH_INFO: `/v3/projects/2c54e69cd3b543429da2543746ecf41a/users/2143f15be61541d498d8951ef70e903c/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.388454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f4b1-6945-4147-96d0-95680d9cf282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c54e69cd3b543429da2543746ecf41a, user_id=2143f15be61541d498d8951ef70e903c, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:01.391206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f4b1-6945-4147-96d0-95680d9cf282 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.405410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1150/2291] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:01 2022] PUT /identity/v3/projects/2c54e69cd3b543429da2543746ecf41a/users/2143f15be61541d498d8951ef70e903c/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:35:01.409471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8d9d-905d-499d-baaa-3700ea08de1e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:01.419640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8d9d-905d-499d-baaa-3700ea08de1e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:01.494639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9aa71-d7ad-4e5d-aae8-366f251fca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:01.495263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9aa71-d7ad-4e5d-aae8-366f251fca97 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.495546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9aa71-d7ad-4e5d-aae8-366f251fca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.498444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9aa71-d7ad-4e5d-aae8-366f251fca97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.499831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9aa71-d7ad-4e5d-aae8-366f251fca97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:01.503566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9aa71-d7ad-4e5d-aae8-366f251fca97 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.520912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1142/2292] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:01.527475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f4b1-6945-4147-96d0-95680d9cf282 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:01.537378 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f4b1-6945-4147-96d0-95680d9cf282 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:01.542238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:01.542893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.543174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.543445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] PATH_INFO: `/v3/projects/2c54e69cd3b543429da2543746ecf41a/users/2143f15be61541d498d8951ef70e903c/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.545359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c54e69cd3b543429da2543746ecf41a, user_id=2143f15be61541d498d8951ef70e903c, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:01.548112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.559120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1151/2293] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:01 2022] PUT /identity/v3/projects/2c54e69cd3b543429da2543746ecf41a/users/2143f15be61541d498d8951ef70e903c/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:35:01.572711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37e22-b9f4-4954-a90e-274e1bae2c67 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.572711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37e22-b9f4-4954-a90e-274e1bae2c67 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.572711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37e22-b9f4-4954-a90e-274e1bae2c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.605742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-33b37e22-b9f4-4954-a90e-274e1bae2c67 None None] MFA Rules not processed for user `2143f15be61541d498d8951ef70e903c`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:01.606990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-33b37e22-b9f4-4954-a90e-274e1bae2c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:01.612633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:01.693194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1143/2294] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:01.704814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:01.708145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:01.765285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e718ba-a21d-4edc-a8f0-33495729658e admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:01.769212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c898e9-d23c-444e-9282-e5f20b9710f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:01.769818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c898e9-d23c-444e-9282-e5f20b9710f1 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.770138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c898e9-d23c-444e-9282-e5f20b9710f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.770419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c898e9-d23c-444e-9282-e5f20b9710f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.779591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c898e9-d23c-444e-9282-e5f20b9710f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:01.781023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c898e9-d23c-444e-9282-e5f20b9710f1 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.791292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1152/2295] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:01.873890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37e22-b9f4-4954-a90e-274e1bae2c67 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:01.884173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37e22-b9f4-4954-a90e-274e1bae2c67 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:01.888160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281c2d7-0450-4e4f-94d2-640782470873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:01.888765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281c2d7-0450-4e4f-94d2-640782470873 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:01.889042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281c2d7-0450-4e4f-94d2-640782470873 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:01.889324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281c2d7-0450-4e4f-94d2-640782470873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:01.951044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281c2d7-0450-4e4f-94d2-640782470873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:01.952505 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281c2d7-0450-4e4f-94d2-640782470873 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:01.962390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1144/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:11.786652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=5,keystone:SELECT=43 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:11.958353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=54 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:16.868178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c898e9-d23c-444e-9282-e5f20b9710f1 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:16.929376 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c898e9-d23c-444e-9282-e5f20b9710f1 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:16.934052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:16.934703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:16.934989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:16.935267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] PATH_INFO: `/v3/users/cda511afac704af8b7cdb66a44043468` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:16.936440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda511afac704af8b7cdb66a44043468)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:16.938389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:16.984066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda511afac704af8b7cdb66a44043468'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:16.990794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda511afac704af8b7cdb66a44043468'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:16.991481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda511afac704af8b7cdb66a44043468'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:16.992093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda511afac704af8b7cdb66a44043468'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.004682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda511afac704af8b7cdb66a44043468'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.017134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1153/2297] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:16 2022] DELETE /identity/v3/users/cda511afac704af8b7cdb66a44043468 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:17.022263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba222b3-3797-440c-9e25-117201b06762 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:17.022779 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba222b3-3797-440c-9e25-117201b06762 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:17.022886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba222b3-3797-440c-9e25-117201b06762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:17.042200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-0ba222b3-3797-440c-9e25-117201b06762 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:17.043440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0ba222b3-3797-440c-9e25-117201b06762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:17.116289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1145/2298] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:17.126670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:17.128144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:17.185580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e776b-5442-42e6-93f3-303d6bb3fdcd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:17.189717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5926e-079b-47b5-967f-37a00f21b0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:17.190352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5926e-079b-47b5-967f-37a00f21b0ca service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:17.190636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5926e-079b-47b5-967f-37a00f21b0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:17.190906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5926e-079b-47b5-967f-37a00f21b0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:17.199843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5926e-079b-47b5-967f-37a00f21b0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:17.201262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5926e-079b-47b5-967f-37a00f21b0ca service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:17.211961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1154/2299] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:17.585740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba222b3-3797-440c-9e25-117201b06762 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:17.588044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0ba222b3-3797-440c-9e25-117201b06762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:17.603524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba222b3-3797-440c-9e25-117201b06762 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:17.608875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:17.609514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:17.610497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:17.610777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] PATH_INFO: `/v3/projects/5014acbcd8a84ad4a65be80cbf8b806e` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:17.613426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5014acbcd8a84ad4a65be80cbf8b806e)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:17.615367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:17.662367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5014acbcd8a84ad4a65be80cbf8b806e', 'request_id': 'req-4a31851c-0cda-40bf-88cd-b6703262f1d7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.667805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5014acbcd8a84ad4a65be80cbf8b806e', 'request_id': 'req-4a31851c-0cda-40bf-88cd-b6703262f1d7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.674822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5014acbcd8a84ad4a65be80cbf8b806e', 'request_id': 'req-4a31851c-0cda-40bf-88cd-b6703262f1d7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.687190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] The token cache is being invalidate because project 5014acbcd8a84ad4a65be80cbf8b806e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:17.687483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.688139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.690285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1146/2300] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:17 2022] DELETE /identity/v3/projects/5014acbcd8a84ad4a65be80cbf8b806e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:17.694361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5926e-079b-47b5-967f-37a00f21b0ca service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:17.704103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5926e-079b-47b5-967f-37a00f21b0ca service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:17.733692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:17.776446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:17.777070 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:17.777347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:17.777638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] PATH_INFO: `/v3/users/2143f15be61541d498d8951ef70e903c` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:17.778771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2143f15be61541d498d8951ef70e903c)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:17.780818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:17.827130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2143f15be61541d498d8951ef70e903c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.834334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2143f15be61541d498d8951ef70e903c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.834959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2143f15be61541d498d8951ef70e903c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.835569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2143f15be61541d498d8951ef70e903c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.848830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e27a374-c1cb-403f-9f11-bee2b9954974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2143f15be61541d498d8951ef70e903c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:17.862482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1155/2301] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:17 2022] DELETE /identity/v3/users/2143f15be61541d498d8951ef70e903c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:35:18.132025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.133511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:18.150596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31851c-0cda-40bf-88cd-b6703262f1d7 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:18.210788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:18.211436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.211724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.211999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] PATH_INFO: `/v3/projects/2c54e69cd3b543429da2543746ecf41a` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.213146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c54e69cd3b543429da2543746ecf41a)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:18.215091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:18.246449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:18.264930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c54e69cd3b543429da2543746ecf41a', 'request_id': 'req-e9e9a142-687a-4ade-a1da-141907130236'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:18.271374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c54e69cd3b543429da2543746ecf41a', 'request_id': 'req-e9e9a142-687a-4ade-a1da-141907130236'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:18.277579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c54e69cd3b543429da2543746ecf41a', 'request_id': 'req-e9e9a142-687a-4ade-a1da-141907130236'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:18.292429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] The token cache is being invalidate because project 2c54e69cd3b543429da2543746ecf41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:18.292817 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:18.293708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e9e9a142-687a-4ade-a1da-141907130236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:18.295235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1147/2302] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:18 2022] DELETE /identity/v3/projects/2c54e69cd3b543429da2543746ecf41a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:18.300194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360c00-630a-40f7-b073-277e876b327b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.300674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360c00-630a-40f7-b073-277e876b327b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.300912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360c00-630a-40f7-b073-277e876b327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.321158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f3360c00-630a-40f7-b073-277e876b327b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:18.322414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f3360c00-630a-40f7-b073-277e876b327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:18.381414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1156/2303] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:18.390308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570012-ca8e-4269-93b4-e22f05f0ed7a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.390662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570012-ca8e-4269-93b4-e22f05f0ed7a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.390970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570012-ca8e-4269-93b4-e22f05f0ed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.412056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-eb570012-ca8e-4269-93b4-e22f05f0ed7a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:18.413260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-eb570012-ca8e-4269-93b4-e22f05f0ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:18.421886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1148/2304] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:18.425947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360c00-630a-40f7-b073-277e876b327b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.436644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360c00-630a-40f7-b073-277e876b327b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:18.441639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:18.442516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.442895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.443262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.444000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:35:18.444404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:18.446322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:18.461262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1157/2305] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:35:18.466777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb570012-ca8e-4269-93b4-e22f05f0ed7a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.477573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb570012-ca8e-4269-93b4-e22f05f0ed7a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:18.482407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0dc9c-7455-4479-987c-ef7b2b1a7abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:18.483012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0dc9c-7455-4479-987c-ef7b2b1a7abe admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.483292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0dc9c-7455-4479-987c-ef7b2b1a7abe admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.483684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0dc9c-7455-4479-987c-ef7b2b1a7abe admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.484312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0dc9c-7455-4479-987c-ef7b2b1a7abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:18.486272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0dc9c-7455-4479-987c-ef7b2b1a7abe admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:18.520383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1149/2306] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:18 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:18.525958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.536789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277df23-b5e4-4660-93f0-b6f2809e6748 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:18.562520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:18.600518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b83ef-c8ed-4f0b-a9f1-f518fd00ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:18.601126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b83ef-c8ed-4f0b-a9f1-f518fd00ddc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.601404 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b83ef-c8ed-4f0b-a9f1-f518fd00ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.601677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b83ef-c8ed-4f0b-a9f1-f518fd00ddc4 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.602329 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b83ef-c8ed-4f0b-a9f1-f518fd00ddc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:18.604796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b83ef-c8ed-4f0b-a9f1-f518fd00ddc4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:18.625468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1158/2307] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:18 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:18.630267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0dc9c-7455-4479-987c-ef7b2b1a7abe admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.640520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0dc9c-7455-4479-987c-ef7b2b1a7abe admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:18.645993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec216-28ff-47a1-ba5e-4680ce789a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:18.646605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec216-28ff-47a1-ba5e-4680ce789a77 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.646906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec216-28ff-47a1-ba5e-4680ce789a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.647155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec216-28ff-47a1-ba5e-4680ce789a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.647799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec216-28ff-47a1-ba5e-4680ce789a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:18.649398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec216-28ff-47a1-ba5e-4680ce789a77 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:18.659611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1150/2308] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:18.663330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b83ef-c8ed-4f0b-a9f1-f518fd00ddc4 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.673312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b83ef-c8ed-4f0b-a9f1-f518fd00ddc4 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:18.678034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd32911-ec8b-4c8c-9f20-4b406b9c52f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:18.678645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32911-ec8b-4c8c-9f20-4b406b9c52f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.678926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32911-ec8b-4c8c-9f20-4b406b9c52f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.679201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32911-ec8b-4c8c-9f20-4b406b9c52f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.679844 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd32911-ec8b-4c8c-9f20-4b406b9c52f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:18.681411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd32911-ec8b-4c8c-9f20-4b406b9c52f0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:18.692222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1159/2309] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:18.696198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec216-28ff-47a1-ba5e-4680ce789a77 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.707113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec216-28ff-47a1-ba5e-4680ce789a77 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:18.711764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b622d-0794-4ae9-bcec-28a864940bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:18.712347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b622d-0794-4ae9-bcec-28a864940bae admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.712633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b622d-0794-4ae9-bcec-28a864940bae admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.712911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b622d-0794-4ae9-bcec-28a864940bae admin admin] PATH_INFO: `/v3/projects/da25caa5545a4d2c9bee04791d0eb2dc/users/8deed389e68c4abfb63ed892a84351eb/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.727294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b622d-0794-4ae9-bcec-28a864940bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=da25caa5545a4d2c9bee04791d0eb2dc, user_id=8deed389e68c4abfb63ed892a84351eb, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:18.730488 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b622d-0794-4ae9-bcec-28a864940bae admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:18.743357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1151/2310] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:18 2022] PUT /identity/v3/projects/da25caa5545a4d2c9bee04791d0eb2dc/users/8deed389e68c4abfb63ed892a84351eb/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:18.755220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b80bf-9a64-40b8-a194-0096c02ce911 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.755509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b80bf-9a64-40b8-a194-0096c02ce911 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.755782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b80bf-9a64-40b8-a194-0096c02ce911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.783707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b10b80bf-9a64-40b8-a194-0096c02ce911 None None] MFA Rules not processed for user `8deed389e68c4abfb63ed892a84351eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:18.784934 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b10b80bf-9a64-40b8-a194-0096c02ce911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:18.847969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1160/2311] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:18.854285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b622d-0794-4ae9-bcec-28a864940bae admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.918089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b622d-0794-4ae9-bcec-28a864940bae admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:18.924478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169aba1-f05f-458f-aa38-22232298ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:18.925094 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169aba1-f05f-458f-aa38-22232298ad03 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:18.925407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169aba1-f05f-458f-aa38-22232298ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:18.925685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169aba1-f05f-458f-aa38-22232298ad03 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:18.926353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169aba1-f05f-458f-aa38-22232298ad03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:18.928329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169aba1-f05f-458f-aa38-22232298ad03 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:18.959035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1152/2312] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:18 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:18.961921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b80bf-9a64-40b8-a194-0096c02ce911 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:18.972488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b80bf-9a64-40b8-a194-0096c02ce911 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:19.029127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab71901-d3ee-4bf0-b04c-7e6dc05b6e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:19.029741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab71901-d3ee-4bf0-b04c-7e6dc05b6e4e admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.030025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab71901-d3ee-4bf0-b04c-7e6dc05b6e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.030364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab71901-d3ee-4bf0-b04c-7e6dc05b6e4e admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.030987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab71901-d3ee-4bf0-b04c-7e6dc05b6e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:19.032932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab71901-d3ee-4bf0-b04c-7e6dc05b6e4e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:19.054036 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1161/2313] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:18 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:19.057982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169aba1-f05f-458f-aa38-22232298ad03 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:19.068835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169aba1-f05f-458f-aa38-22232298ad03 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:19.073391 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0074b0-9123-4375-a3d5-a520834eb03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:19.073985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0074b0-9123-4375-a3d5-a520834eb03a admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.074299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0074b0-9123-4375-a3d5-a520834eb03a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.074576 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0074b0-9123-4375-a3d5-a520834eb03a admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.075216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0074b0-9123-4375-a3d5-a520834eb03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:19.076814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0074b0-9123-4375-a3d5-a520834eb03a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:19.087159 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1153/2314] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:19.091131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab71901-d3ee-4bf0-b04c-7e6dc05b6e4e admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:19.101255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab71901-d3ee-4bf0-b04c-7e6dc05b6e4e admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:19.105947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49257dcc-1932-418a-8207-c9295be990e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:19.106633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257dcc-1932-418a-8207-c9295be990e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.106940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257dcc-1932-418a-8207-c9295be990e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.107220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257dcc-1932-418a-8207-c9295be990e7 admin admin] PATH_INFO: `/v3/projects/b25d9de7b23e41ed998fe02389552e30/users/61edab4f2288490f81d8b683ab02fdd6/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.121970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49257dcc-1932-418a-8207-c9295be990e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25d9de7b23e41ed998fe02389552e30, user_id=61edab4f2288490f81d8b683ab02fdd6, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:19.124634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49257dcc-1932-418a-8207-c9295be990e7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:19.137704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1162/2315] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:19 2022] PUT /identity/v3/projects/b25d9de7b23e41ed998fe02389552e30/users/61edab4f2288490f81d8b683ab02fdd6/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:19.141691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0074b0-9123-4375-a3d5-a520834eb03a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:19.151794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0074b0-9123-4375-a3d5-a520834eb03a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:19.171257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:19.215173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ef87f-d80c-46ec-bea8-627e4e3f7266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:19.215778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ef87f-d80c-46ec-bea8-627e4e3f7266 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.216060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ef87f-d80c-46ec-bea8-627e4e3f7266 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.216334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ef87f-d80c-46ec-bea8-627e4e3f7266 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.216989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ef87f-d80c-46ec-bea8-627e4e3f7266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:19.218607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ef87f-d80c-46ec-bea8-627e4e3f7266 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:19.228357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1154/2316] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:35:19.232554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49257dcc-1932-418a-8207-c9295be990e7 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:19.238525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:19.244590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49257dcc-1932-418a-8207-c9295be990e7 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:19.249598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:19.250304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.251217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.251491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] PATH_INFO: `/v3/projects/b25d9de7b23e41ed998fe02389552e30/users/61edab4f2288490f81d8b683ab02fdd6/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.253386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25d9de7b23e41ed998fe02389552e30, user_id=61edab4f2288490f81d8b683ab02fdd6, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:19.256038 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:19.266028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1163/2317] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:19 2022] PUT /identity/v3/projects/b25d9de7b23e41ed998fe02389552e30/users/61edab4f2288490f81d8b683ab02fdd6/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:19.276335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9eb8-7aec-482a-8cb2-063d878dd945 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.276621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9eb8-7aec-482a-8cb2-063d878dd945 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.276895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9eb8-7aec-482a-8cb2-063d878dd945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.305796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-066a9eb8-7aec-482a-8cb2-063d878dd945 None None] MFA Rules not processed for user `61edab4f2288490f81d8b683ab02fdd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:19.307042 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-066a9eb8-7aec-482a-8cb2-063d878dd945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:19.372814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1155/2318] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:19.383825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:19.385566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:19.443665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335872b-4534-4fbf-b29e-64f1619a3b64 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:19.447322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae2ad5-0f6d-4f91-86c6-19e963fb0663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:19.447949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae2ad5-0f6d-4f91-86c6-19e963fb0663 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.448231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae2ad5-0f6d-4f91-86c6-19e963fb0663 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.448504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae2ad5-0f6d-4f91-86c6-19e963fb0663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.457324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae2ad5-0f6d-4f91-86c6-19e963fb0663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:19.458761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae2ad5-0f6d-4f91-86c6-19e963fb0663 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:19.468057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1164/2319] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:19.540630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9eb8-7aec-482a-8cb2-063d878dd945 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:19.550769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9eb8-7aec-482a-8cb2-063d878dd945 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:19.554370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf519ac-7913-446c-bb6d-579de2dd6dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:19.554961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf519ac-7913-446c-bb6d-579de2dd6dda service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.555241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf519ac-7913-446c-bb6d-579de2dd6dda service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.555513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf519ac-7913-446c-bb6d-579de2dd6dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.612013 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf519ac-7913-446c-bb6d-579de2dd6dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:19.613507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf519ac-7913-446c-bb6d-579de2dd6dda service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:19.622839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1156/2320] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:19.962379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1b63-7098-4d04-9725-2a12f21e6579 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.962691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1b63-7098-4d04-9725-2a12f21e6579 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.962967 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1b63-7098-4d04-9725-2a12f21e6579 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.964312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1165/2321] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 00:35:19.971604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037315f-512e-45bf-a3fb-142160f96fb1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:19.972098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037315f-512e-45bf-a3fb-142160f96fb1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:19.972401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037315f-512e-45bf-a3fb-142160f96fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:19.992404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d037315f-512e-45bf-a3fb-142160f96fb1 None None] MFA Rules not processed for user `17a501a048ed4b6c8186bfd490ad1394`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:19.993776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d037315f-512e-45bf-a3fb-142160f96fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:20.036594 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:20.048473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1157/2322] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:35:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:20.060637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e1b63-7098-4d04-9725-2a12f21e6579 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:20.062394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-768e1b63-7098-4d04-9725-2a12f21e6579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:20.079349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e1b63-7098-4d04-9725-2a12f21e6579 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:20.082949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23a0ce-0c85-4a15-a2db-170676816f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:20.083543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a0ce-0c85-4a15-a2db-170676816f75 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:20.083821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a0ce-0c85-4a15-a2db-170676816f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:20.084189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a0ce-0c85-4a15-a2db-170676816f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:20.091505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23a0ce-0c85-4a15-a2db-170676816f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:20.092903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23a0ce-0c85-4a15-a2db-170676816f75 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:20.100814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1166/2323] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:20.185752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bf237-3d87-4188-9278-fe7f3c9c2e30 None None] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:20.186219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bf237-3d87-4188-9278-fe7f3c9c2e30 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:20.186352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bf237-3d87-4188-9278-fe7f3c9c2e30 None None] PATH_INFO: `/` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:20.187733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1158/2324] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:35:20.193457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ea329-256e-45db-8f35-2e0d3a092ed6 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:20.193771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ea329-256e-45db-8f35-2e0d3a092ed6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:20.194050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ea329-256e-45db-8f35-2e0d3a092ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:20.213761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-682ea329-256e-45db-8f35-2e0d3a092ed6 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:20.214984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-682ea329-256e-45db-8f35-2e0d3a092ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:20.280152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1167/2325] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:35:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:20.290810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bf237-3d87-4188-9278-fe7f3c9c2e30 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:20.292525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c42bf237-3d87-4188-9278-fe7f3c9c2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:20.305694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bf237-3d87-4188-9278-fe7f3c9c2e30 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:20.309280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1494498-7b16-4356-aa28-7aa0f8cd8fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:20.309869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1494498-7b16-4356-aa28-7aa0f8cd8fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:20.310322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1494498-7b16-4356-aa28-7aa0f8cd8fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:20.310629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1494498-7b16-4356-aa28-7aa0f8cd8fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:20.321213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1494498-7b16-4356-aa28-7aa0f8cd8fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:20.322691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1494498-7b16-4356-aa28-7aa0f8cd8fd3 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:20.333709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1159/2326] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:22.694180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ea329-256e-45db-8f35-2e0d3a092ed6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:22.756610 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ea329-256e-45db-8f35-2e0d3a092ed6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:22.761130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:22.761749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:22.762030 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:22.762363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] PATH_INFO: `/v3/users/8deed389e68c4abfb63ed892a84351eb` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:22.763484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8deed389e68c4abfb63ed892a84351eb)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:22.765391 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:22.778277 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:22.812362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8deed389e68c4abfb63ed892a84351eb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:22.819957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8deed389e68c4abfb63ed892a84351eb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:22.820785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8deed389e68c4abfb63ed892a84351eb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:22.821448 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8deed389e68c4abfb63ed892a84351eb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:22.835637 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8deed389e68c4abfb63ed892a84351eb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:22.848303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1168/2327] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:22 2022] DELETE /identity/v3/users/8deed389e68c4abfb63ed892a84351eb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:22.852915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083367ab-8cf2-491f-b275-4cb8abc79195 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:22.853372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083367ab-8cf2-491f-b275-4cb8abc79195 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:22.853473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083367ab-8cf2-491f-b275-4cb8abc79195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:22.872336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-083367ab-8cf2-491f-b275-4cb8abc79195 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:22.873545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-083367ab-8cf2-491f-b275-4cb8abc79195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:22.930846 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1160/2328] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:35:22.940513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:22.941905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:22.998126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a295691-d602-4245-a402-409374fabae6 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:23.002499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac2ba8-3493-4529-94dd-a684651de105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:23.003132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac2ba8-3493-4529-94dd-a684651de105 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:23.003412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac2ba8-3493-4529-94dd-a684651de105 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:23.003686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac2ba8-3493-4529-94dd-a684651de105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:23.012712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac2ba8-3493-4529-94dd-a684651de105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:23.014085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac2ba8-3493-4529-94dd-a684651de105 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:23.024169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1169/2329] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:23.299569 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083367ab-8cf2-491f-b275-4cb8abc79195 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:23.301002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-083367ab-8cf2-491f-b275-4cb8abc79195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:23.315865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083367ab-8cf2-491f-b275-4cb8abc79195 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:23.320793 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:23.321426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:23.321775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:23.322090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] PATH_INFO: `/v3/projects/da25caa5545a4d2c9bee04791d0eb2dc` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:23.323320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da25caa5545a4d2c9bee04791d0eb2dc)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:23.325350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:23.373405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da25caa5545a4d2c9bee04791d0eb2dc', 'request_id': 'req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.379519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da25caa5545a4d2c9bee04791d0eb2dc', 'request_id': 'req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.385621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da25caa5545a4d2c9bee04791d0eb2dc', 'request_id': 'req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.398551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] The token cache is being invalidate because project da25caa5545a4d2c9bee04791d0eb2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:23.398871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.399489 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.400987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1161/2330] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:23 2022] DELETE /identity/v3/projects/da25caa5545a4d2c9bee04791d0eb2dc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:23.405041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac2ba8-3493-4529-94dd-a684651de105 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:23.414753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac2ba8-3493-4529-94dd-a684651de105 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:23.470006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:23.470661 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:23.470942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:23.471217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] PATH_INFO: `/v3/users/61edab4f2288490f81d8b683ab02fdd6` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:23.472365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61edab4f2288490f81d8b683ab02fdd6)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:23.474390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:23.523538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:23.535418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61edab4f2288490f81d8b683ab02fdd6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.543243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61edab4f2288490f81d8b683ab02fdd6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.543789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61edab4f2288490f81d8b683ab02fdd6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.544412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61edab4f2288490f81d8b683ab02fdd6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.556949 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-43fd70d1-d45e-4423-807e-329806b15c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61edab4f2288490f81d8b683ab02fdd6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.570140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1170/2331] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:23 2022] DELETE /identity/v3/users/61edab4f2288490f81d8b683ab02fdd6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:35:23.847960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:23.854128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:23.870186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a0c4c-4572-45ce-8796-571fcdd0ae37 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:23.926747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:23.927370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:23.927650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:23.927922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] PATH_INFO: `/v3/projects/b25d9de7b23e41ed998fe02389552e30` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:23.929015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25d9de7b23e41ed998fe02389552e30)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:23.930972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:23.936945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:23.976783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25d9de7b23e41ed998fe02389552e30', 'request_id': 'req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.982184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25d9de7b23e41ed998fe02389552e30', 'request_id': 'req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:23.988811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25d9de7b23e41ed998fe02389552e30', 'request_id': 'req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:24.001124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] The token cache is being invalidate because project b25d9de7b23e41ed998fe02389552e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:24.001417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:24.002038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a12cc9e9-c4fa-4bf8-9dc1-0ee61591ea20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:24.003535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1162/2332] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:23 2022] DELETE /identity/v3/projects/b25d9de7b23e41ed998fe02389552e30 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:24.009443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d361e-7be2-4591-9f37-634a2656baea None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.009911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d361e-7be2-4591-9f37-634a2656baea None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.010021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d361e-7be2-4591-9f37-634a2656baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.029176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-7d9d361e-7be2-4591-9f37-634a2656baea None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:24.030415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7d9d361e-7be2-4591-9f37-634a2656baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:24.087855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1171/2333] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:35:24.096309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d471f9-961f-479b-b5fc-bd9e724ca50a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.096539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d471f9-961f-479b-b5fc-bd9e724ca50a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.096810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d471f9-961f-479b-b5fc-bd9e724ca50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.116698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-98d471f9-961f-479b-b5fc-bd9e724ca50a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:24.117887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-98d471f9-961f-479b-b5fc-bd9e724ca50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:24.126041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1163/2334] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:35:24.130366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d361e-7be2-4591-9f37-634a2656baea None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.139885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d361e-7be2-4591-9f37-634a2656baea None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.145184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.145768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.146048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.146350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.146991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:35:24.147292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.148887 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.160846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1172/2335] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:35:24.165032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d471f9-961f-479b-b5fc-bd9e724ca50a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.174205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d471f9-961f-479b-b5fc-bd9e724ca50a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.178807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ca02-bbad-489e-97f7-1fb058a90a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.179388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ca02-bbad-489e-97f7-1fb058a90a07 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.179664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ca02-bbad-489e-97f7-1fb058a90a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.179931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ca02-bbad-489e-97f7-1fb058a90a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.180545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ca02-bbad-489e-97f7-1fb058a90a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.182469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ca02-bbad-489e-97f7-1fb058a90a07 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.209008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1164/2336] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:24 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:24.212978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.223454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a9b75-47ab-4e51-b9d5-be870170beab admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.277723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997237-fabd-4fc6-8fc7-1d3b7fe04a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.278352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997237-fabd-4fc6-8fc7-1d3b7fe04a16 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.278635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997237-fabd-4fc6-8fc7-1d3b7fe04a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.278910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997237-fabd-4fc6-8fc7-1d3b7fe04a16 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.279520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997237-fabd-4fc6-8fc7-1d3b7fe04a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.281431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997237-fabd-4fc6-8fc7-1d3b7fe04a16 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.303272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1173/2337] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:24 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:24.307370 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ca02-bbad-489e-97f7-1fb058a90a07 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.317767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ca02-bbad-489e-97f7-1fb058a90a07 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.322471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cf867-fbc5-47b3-a6d4-4cb3a26092c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.323054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf867-fbc5-47b3-a6d4-4cb3a26092c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.323333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf867-fbc5-47b3-a6d4-4cb3a26092c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.323604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf867-fbc5-47b3-a6d4-4cb3a26092c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.324236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cf867-fbc5-47b3-a6d4-4cb3a26092c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.325816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cf867-fbc5-47b3-a6d4-4cb3a26092c5 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.336193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1165/2338] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:35:24.340046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997237-fabd-4fc6-8fc7-1d3b7fe04a16 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.350687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997237-fabd-4fc6-8fc7-1d3b7fe04a16 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.355253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ccbde-5873-4142-81e6-fc493c1c42ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.355832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ccbde-5873-4142-81e6-fc493c1c42ef admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.356112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ccbde-5873-4142-81e6-fc493c1c42ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.356385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ccbde-5873-4142-81e6-fc493c1c42ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.357019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ccbde-5873-4142-81e6-fc493c1c42ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.358665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ccbde-5873-4142-81e6-fc493c1c42ef admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.369994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1174/2339] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:35:24.373848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cf867-fbc5-47b3-a6d4-4cb3a26092c5 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.383655 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cf867-fbc5-47b3-a6d4-4cb3a26092c5 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.388245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08579dd3-425b-4b77-8c33-0f8141b2f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.388884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579dd3-425b-4b77-8c33-0f8141b2f39c admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.389165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579dd3-425b-4b77-8c33-0f8141b2f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.389461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579dd3-425b-4b77-8c33-0f8141b2f39c admin admin] PATH_INFO: `/v3/projects/1b7477bf7f784f9d896119aa069dae8f/users/900e07065c6f450a9e0f0571827a61c6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.405363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579dd3-425b-4b77-8c33-0f8141b2f39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7477bf7f784f9d896119aa069dae8f, user_id=900e07065c6f450a9e0f0571827a61c6, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.408656 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579dd3-425b-4b77-8c33-0f8141b2f39c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.420979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1166/2340] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:24 2022] PUT /identity/v3/projects/1b7477bf7f784f9d896119aa069dae8f/users/900e07065c6f450a9e0f0571827a61c6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:24.432025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f914a-b37d-4419-8d78-50f81e9f91ee None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.432315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f914a-b37d-4419-8d78-50f81e9f91ee None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.432593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f914a-b37d-4419-8d78-50f81e9f91ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.459719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ff5f914a-b37d-4419-8d78-50f81e9f91ee None None] MFA Rules not processed for user `900e07065c6f450a9e0f0571827a61c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:24.460933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ff5f914a-b37d-4419-8d78-50f81e9f91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:24.466110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:24.526561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1175/2341] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:24.530983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08579dd3-425b-4b77-8c33-0f8141b2f39c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.591193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08579dd3-425b-4b77-8c33-0f8141b2f39c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.596121 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b94c7-f59f-4e30-af13-a4ff3ab9b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.596722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b94c7-f59f-4e30-af13-a4ff3ab9b937 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.597003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b94c7-f59f-4e30-af13-a4ff3ab9b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.597277 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b94c7-f59f-4e30-af13-a4ff3ab9b937 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.597926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b94c7-f59f-4e30-af13-a4ff3ab9b937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.599896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b94c7-f59f-4e30-af13-a4ff3ab9b937 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.625865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1167/2342] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:24 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:24.629889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f914a-b37d-4419-8d78-50f81e9f91ee None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.640390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f914a-b37d-4419-8d78-50f81e9f91ee None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.696574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e2faa-a48a-45fc-9e6c-f04c5005ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.697175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e2faa-a48a-45fc-9e6c-f04c5005ee26 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.697453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e2faa-a48a-45fc-9e6c-f04c5005ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.697723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e2faa-a48a-45fc-9e6c-f04c5005ee26 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.698412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e2faa-a48a-45fc-9e6c-f04c5005ee26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.700300 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e2faa-a48a-45fc-9e6c-f04c5005ee26 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.722183 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1176/2343] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:24 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:24.725903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b94c7-f59f-4e30-af13-a4ff3ab9b937 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.749961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b94c7-f59f-4e30-af13-a4ff3ab9b937 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.756938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4589ad4-9d0c-4ccc-9396-db3e7ba49b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.757592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589ad4-9d0c-4ccc-9396-db3e7ba49b5d admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.757929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589ad4-9d0c-4ccc-9396-db3e7ba49b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.758298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589ad4-9d0c-4ccc-9396-db3e7ba49b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.759037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4589ad4-9d0c-4ccc-9396-db3e7ba49b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.760904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4589ad4-9d0c-4ccc-9396-db3e7ba49b5d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.782127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1168/2344] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:24.786573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e2faa-a48a-45fc-9e6c-f04c5005ee26 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.802732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e2faa-a48a-45fc-9e6c-f04c5005ee26 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.811608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efec319-7370-4691-ba76-4a24adec0ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.814839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec319-7370-4691-ba76-4a24adec0ded admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.815220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec319-7370-4691-ba76-4a24adec0ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.815561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec319-7370-4691-ba76-4a24adec0ded admin admin] PATH_INFO: `/v3/projects/8855ac736ed34ca0a9d1d998e4166bfb/users/e6d5858fa86d43c48edc73fb4fd476d3/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.835424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efec319-7370-4691-ba76-4a24adec0ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=8855ac736ed34ca0a9d1d998e4166bfb, user_id=e6d5858fa86d43c48edc73fb4fd476d3, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.838192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efec319-7370-4691-ba76-4a24adec0ded admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.852600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1177/2345] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:24 2022] PUT /identity/v3/projects/8855ac736ed34ca0a9d1d998e4166bfb/users/e6d5858fa86d43c48edc73fb4fd476d3/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:24.856750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4589ad4-9d0c-4ccc-9396-db3e7ba49b5d admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.864067 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:24.868097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4589ad4-9d0c-4ccc-9396-db3e7ba49b5d admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.931382 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3049e-5a7f-497e-b472-5c9c42c0f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.931904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3049e-5a7f-497e-b472-5c9c42c0f443 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.932183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3049e-5a7f-497e-b472-5c9c42c0f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.932459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3049e-5a7f-497e-b472-5c9c42c0f443 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.933105 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3049e-5a7f-497e-b472-5c9c42c0f443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.934741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3049e-5a7f-497e-b472-5c9c42c0f443 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.945170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1169/2346] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:24.949322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efec319-7370-4691-ba76-4a24adec0ded admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:24.960190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efec319-7370-4691-ba76-4a24adec0ded admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:24.966908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:24.967924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:24.968049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:24.968241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] PATH_INFO: `/v3/projects/8855ac736ed34ca0a9d1d998e4166bfb/users/e6d5858fa86d43c48edc73fb4fd476d3/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:24.970834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8855ac736ed34ca0a9d1d998e4166bfb, user_id=e6d5858fa86d43c48edc73fb4fd476d3, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:24.976779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:24.989464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1178/2347] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:24 2022] PUT /identity/v3/projects/8855ac736ed34ca0a9d1d998e4166bfb/users/e6d5858fa86d43c48edc73fb4fd476d3/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:24.999886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25487ccb-93a8-479f-a4f6-36a6f2ff248b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:25.000172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25487ccb-93a8-479f-a4f6-36a6f2ff248b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:25.000991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25487ccb-93a8-479f-a4f6-36a6f2ff248b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:25.028701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-25487ccb-93a8-479f-a4f6-36a6f2ff248b None None] MFA Rules not processed for user `e6d5858fa86d43c48edc73fb4fd476d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:25.029917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-25487ccb-93a8-479f-a4f6-36a6f2ff248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:25.098118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1170/2348] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:25.109290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:25.111553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:25.167919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1fb09-f96d-4954-81ce-e986927f824f admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:25.171632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693f1c-d268-41ab-aff7-3c9d48c50044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:25.172718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693f1c-d268-41ab-aff7-3c9d48c50044 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:25.173000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693f1c-d268-41ab-aff7-3c9d48c50044 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:25.173272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693f1c-d268-41ab-aff7-3c9d48c50044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:25.182394 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a693f1c-d268-41ab-aff7-3c9d48c50044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:25.183748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a693f1c-d268-41ab-aff7-3c9d48c50044 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:25.193845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1179/2349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:25.238394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25487ccb-93a8-479f-a4f6-36a6f2ff248b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:25.239763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-25487ccb-93a8-479f-a4f6-36a6f2ff248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:25.252026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25487ccb-93a8-479f-a4f6-36a6f2ff248b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:25.255660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db827870-2b71-4b03-9ed2-54a21f7ff2eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:25.256248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db827870-2b71-4b03-9ed2-54a21f7ff2eb service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:25.256527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db827870-2b71-4b03-9ed2-54a21f7ff2eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:25.256800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db827870-2b71-4b03-9ed2-54a21f7ff2eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:25.313476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db827870-2b71-4b03-9ed2-54a21f7ff2eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:25.314939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db827870-2b71-4b03-9ed2-54a21f7ff2eb service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:25.323678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1171/2350] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:28.661511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693f1c-d268-41ab-aff7-3c9d48c50044 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:28.665724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:28.724402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693f1c-d268-41ab-aff7-3c9d48c50044 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:28.729015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:28.729644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:28.729952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:28.730316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] PATH_INFO: `/v3/users/900e07065c6f450a9e0f0571827a61c6` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:28.731540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900e07065c6f450a9e0f0571827a61c6)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:28.733578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:28.778224 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900e07065c6f450a9e0f0571827a61c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:28.785677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900e07065c6f450a9e0f0571827a61c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:28.786336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900e07065c6f450a9e0f0571827a61c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:28.787001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900e07065c6f450a9e0f0571827a61c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:28.798652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900e07065c6f450a9e0f0571827a61c6'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:28.810652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1180/2351] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:28 2022] DELETE /identity/v3/users/900e07065c6f450a9e0f0571827a61c6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:28.815296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f676b5-bfda-416b-bf6e-02a0bcdecf1b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:28.815767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f676b5-bfda-416b-bf6e-02a0bcdecf1b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:28.815863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f676b5-bfda-416b-bf6e-02a0bcdecf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:28.834472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e1f676b5-bfda-416b-bf6e-02a0bcdecf1b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:28.835663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e1f676b5-bfda-416b-bf6e-02a0bcdecf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:28.854321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:28.895033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1172/2352] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:28.904697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:28.906090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:28.961546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ced75-83d3-4554-b657-0d46e5fcb229 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:28.965128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df2d91-37d7-4dff-8007-9b701a6ddc6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:28.965717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df2d91-37d7-4dff-8007-9b701a6ddc6a service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:28.965994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df2d91-37d7-4dff-8007-9b701a6ddc6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:28.966295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df2d91-37d7-4dff-8007-9b701a6ddc6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:28.975641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df2d91-37d7-4dff-8007-9b701a6ddc6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:28.977160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df2d91-37d7-4dff-8007-9b701a6ddc6a service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:28.986595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1181/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:35:29.246883 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f676b5-bfda-416b-bf6e-02a0bcdecf1b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:29.248301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e1f676b5-bfda-416b-bf6e-02a0bcdecf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:29.263755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f676b5-bfda-416b-bf6e-02a0bcdecf1b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:29.269496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:29.270161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:29.270445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:29.270727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] PATH_INFO: `/v3/projects/1b7477bf7f784f9d896119aa069dae8f` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:29.271877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7477bf7f784f9d896119aa069dae8f)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:29.273799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:29.321324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7477bf7f784f9d896119aa069dae8f', 'request_id': 'req-de5b62e3-abd0-46ea-b337-12102b73b52c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.326786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7477bf7f784f9d896119aa069dae8f', 'request_id': 'req-de5b62e3-abd0-46ea-b337-12102b73b52c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.333420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7477bf7f784f9d896119aa069dae8f', 'request_id': 'req-de5b62e3-abd0-46ea-b337-12102b73b52c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.344998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] The token cache is being invalidate because project 1b7477bf7f784f9d896119aa069dae8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:29.345285 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.345898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.347393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1173/2354] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:29 2022] DELETE /identity/v3/projects/1b7477bf7f784f9d896119aa069dae8f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:29.351301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df2d91-37d7-4dff-8007-9b701a6ddc6a service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:29.361233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df2d91-37d7-4dff-8007-9b701a6ddc6a service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:29.380851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:29.419339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:29.419955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:29.420233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:29.420507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] PATH_INFO: `/v3/users/e6d5858fa86d43c48edc73fb4fd476d3` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:29.421667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d5858fa86d43c48edc73fb4fd476d3)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:29.424034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:29.467673 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d5858fa86d43c48edc73fb4fd476d3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.474933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d5858fa86d43c48edc73fb4fd476d3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.475541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d5858fa86d43c48edc73fb4fd476d3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.476158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d5858fa86d43c48edc73fb4fd476d3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.488228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ce75efb2-6ec4-45b8-98f4-9a8893cee58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d5858fa86d43c48edc73fb4fd476d3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.500935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1182/2355] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:29 2022] DELETE /identity/v3/users/e6d5858fa86d43c48edc73fb4fd476d3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:29.783763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:29.785253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:29.799234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b62e3-abd0-46ea-b337-12102b73b52c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:29.863874 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:29.864512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:29.864794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:29.865074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] PATH_INFO: `/v3/projects/8855ac736ed34ca0a9d1d998e4166bfb` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:29.866280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8855ac736ed34ca0a9d1d998e4166bfb)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:29.868206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:29.913966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8855ac736ed34ca0a9d1d998e4166bfb', 'request_id': 'req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.915168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:29.921167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8855ac736ed34ca0a9d1d998e4166bfb', 'request_id': 'req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.928771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8855ac736ed34ca0a9d1d998e4166bfb', 'request_id': 'req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.940575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] The token cache is being invalidate because project 8855ac736ed34ca0a9d1d998e4166bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:29.940871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.941610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cf0bf2eb-ef27-42c5-b578-1076199ff2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:29.943089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1174/2356] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:29 2022] DELETE /identity/v3/projects/8855ac736ed34ca0a9d1d998e4166bfb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:29.948035 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae5d2-6c20-458e-a69e-2575214b72c5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:29.948561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae5d2-6c20-458e-a69e-2575214b72c5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:29.948676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae5d2-6c20-458e-a69e-2575214b72c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:29.968533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9e5ae5d2-6c20-458e-a69e-2575214b72c5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:29.970276 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9e5ae5d2-6c20-458e-a69e-2575214b72c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:30.032330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1183/2357] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:35:30.040097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d016b-0ab7-4d91-a0aa-65f7bd25e952 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.040395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d016b-0ab7-4d91-a0aa-65f7bd25e952 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.040674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d016b-0ab7-4d91-a0aa-65f7bd25e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.061471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-fa2d016b-0ab7-4d91-a0aa-65f7bd25e952 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:30.062770 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-fa2d016b-0ab7-4d91-a0aa-65f7bd25e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:30.070667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1175/2358] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:35:30.074812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ae5d2-6c20-458e-a69e-2575214b72c5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.084305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ae5d2-6c20-458e-a69e-2575214b72c5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.088944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.089577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.089867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.090166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.090818 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:35:30.091123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.092700 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.104935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1184/2359] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:35:30.109072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d016b-0ab7-4d91-a0aa-65f7bd25e952 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.118732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d016b-0ab7-4d91-a0aa-65f7bd25e952 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.123243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8dac-5b02-4433-a916-8e6f0525ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.123826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8dac-5b02-4433-a916-8e6f0525ba7a admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.124106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8dac-5b02-4433-a916-8e6f0525ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.124379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8dac-5b02-4433-a916-8e6f0525ba7a admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.124993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b8dac-5b02-4433-a916-8e6f0525ba7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.127026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b8dac-5b02-4433-a916-8e6f0525ba7a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.153633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1176/2360] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:30 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:30.158123 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.168535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc9c17-dceb-4d72-86e9-8bcc6d402639 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.196701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:30.226193 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591fdc4-82f5-4321-8d14-2de6f4765c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.226793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591fdc4-82f5-4321-8d14-2de6f4765c26 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.227076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591fdc4-82f5-4321-8d14-2de6f4765c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.227347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591fdc4-82f5-4321-8d14-2de6f4765c26 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.227961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591fdc4-82f5-4321-8d14-2de6f4765c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.229860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591fdc4-82f5-4321-8d14-2de6f4765c26 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.250003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1185/2361] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:30 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:30.254112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8dac-5b02-4433-a916-8e6f0525ba7a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.264044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8dac-5b02-4433-a916-8e6f0525ba7a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.269280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158023-fa78-4a5d-af79-611ab2d5ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.269880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158023-fa78-4a5d-af79-611ab2d5ca4f admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.270176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158023-fa78-4a5d-af79-611ab2d5ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.270452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158023-fa78-4a5d-af79-611ab2d5ca4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.271089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91158023-fa78-4a5d-af79-611ab2d5ca4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.272675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91158023-fa78-4a5d-af79-611ab2d5ca4f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.283314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1177/2362] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:30.287165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591fdc4-82f5-4321-8d14-2de6f4765c26 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.296806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591fdc4-82f5-4321-8d14-2de6f4765c26 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.301735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4a780-ecd0-4b50-8763-c61e13287285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.302351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a780-ecd0-4b50-8763-c61e13287285 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.302709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a780-ecd0-4b50-8763-c61e13287285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.302994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a780-ecd0-4b50-8763-c61e13287285 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.303631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4a780-ecd0-4b50-8763-c61e13287285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.305619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4a780-ecd0-4b50-8763-c61e13287285 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.316286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1186/2363] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:30.320390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158023-fa78-4a5d-af79-611ab2d5ca4f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.330640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158023-fa78-4a5d-af79-611ab2d5ca4f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.335226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7b7f4-2b43-4856-b56b-8708bb999844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.335856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b7f4-2b43-4856-b56b-8708bb999844 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.336139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b7f4-2b43-4856-b56b-8708bb999844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.336408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b7f4-2b43-4856-b56b-8708bb999844 admin admin] PATH_INFO: `/v3/projects/1fa188afdd464bf3b85403d69b8bdc0e/users/29b322a984d146d3b79a1e21534a4ca2/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.350783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7b7f4-2b43-4856-b56b-8708bb999844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa188afdd464bf3b85403d69b8bdc0e, user_id=29b322a984d146d3b79a1e21534a4ca2, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.353405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7b7f4-2b43-4856-b56b-8708bb999844 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.366118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1178/2364] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:30 2022] PUT /identity/v3/projects/1fa188afdd464bf3b85403d69b8bdc0e/users/29b322a984d146d3b79a1e21534a4ca2/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:30.377227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90642-4e7a-4a5d-a7ae-cce771c82f8e None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.377514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90642-4e7a-4a5d-a7ae-cce771c82f8e None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.377787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90642-4e7a-4a5d-a7ae-cce771c82f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.405108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-38f90642-4e7a-4a5d-a7ae-cce771c82f8e None None] MFA Rules not processed for user `29b322a984d146d3b79a1e21534a4ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:30.407007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-38f90642-4e7a-4a5d-a7ae-cce771c82f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:30.468457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1187/2365] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:35:30.473459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7b7f4-2b43-4856-b56b-8708bb999844 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.534558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7b7f4-2b43-4856-b56b-8708bb999844 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.539227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4705d5d-2572-46e9-8e57-354a2622fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.539822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705d5d-2572-46e9-8e57-354a2622fb5b admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.540103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705d5d-2572-46e9-8e57-354a2622fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.540373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705d5d-2572-46e9-8e57-354a2622fb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.540994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4705d5d-2572-46e9-8e57-354a2622fb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.542983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4705d5d-2572-46e9-8e57-354a2622fb5b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.568962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1179/2366] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:30 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:30.573145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f90642-4e7a-4a5d-a7ae-cce771c82f8e None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.584687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f90642-4e7a-4a5d-a7ae-cce771c82f8e None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.641312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617cfe2-4a49-42ea-b550-8c72e995348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.641917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617cfe2-4a49-42ea-b550-8c72e995348d admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.642231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617cfe2-4a49-42ea-b550-8c72e995348d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.642510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617cfe2-4a49-42ea-b550-8c72e995348d admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.643399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617cfe2-4a49-42ea-b550-8c72e995348d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.645325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617cfe2-4a49-42ea-b550-8c72e995348d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.666516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1188/2367] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:30 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:30.670747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4705d5d-2572-46e9-8e57-354a2622fb5b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.681193 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4705d5d-2572-46e9-8e57-354a2622fb5b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.685724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7076-3e43-48e5-ad96-622c771bb380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.686343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7076-3e43-48e5-ad96-622c771bb380 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.686622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7076-3e43-48e5-ad96-622c771bb380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.686893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7076-3e43-48e5-ad96-622c771bb380 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.687533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c7076-3e43-48e5-ad96-622c771bb380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.689605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c7076-3e43-48e5-ad96-622c771bb380 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.700181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1180/2368] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:30.704769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617cfe2-4a49-42ea-b550-8c72e995348d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.714728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617cfe2-4a49-42ea-b550-8c72e995348d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.719299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d017039-31d2-4e48-b3a2-9f106bb3806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.719884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017039-31d2-4e48-b3a2-9f106bb3806d admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.720160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017039-31d2-4e48-b3a2-9f106bb3806d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.720433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017039-31d2-4e48-b3a2-9f106bb3806d admin admin] PATH_INFO: `/v3/projects/4c5b0ab04f4c4029b962aae77b7cc0df/users/35df23814179489e98d15e5e38118de8/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.734620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d017039-31d2-4e48-b3a2-9f106bb3806d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5b0ab04f4c4029b962aae77b7cc0df, user_id=35df23814179489e98d15e5e38118de8, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.737236 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d017039-31d2-4e48-b3a2-9f106bb3806d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.750952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1189/2369] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:30 2022] PUT /identity/v3/projects/4c5b0ab04f4c4029b962aae77b7cc0df/users/35df23814179489e98d15e5e38118de8/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:30.754635 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7076-3e43-48e5-ad96-622c771bb380 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.764258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7076-3e43-48e5-ad96-622c771bb380 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.807586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:30.821680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82d959-3439-4cc3-b061-a5e89770dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.822310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82d959-3439-4cc3-b061-a5e89770dca2 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.822596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82d959-3439-4cc3-b061-a5e89770dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.822869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82d959-3439-4cc3-b061-a5e89770dca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.823509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82d959-3439-4cc3-b061-a5e89770dca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.825111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82d959-3439-4cc3-b061-a5e89770dca2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.835742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1181/2370] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:30.839849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d017039-31d2-4e48-b3a2-9f106bb3806d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:30.846480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:30.851314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d017039-31d2-4e48-b3a2-9f106bb3806d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:30.857444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:30.858134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.858421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.858697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] PATH_INFO: `/v3/projects/4c5b0ab04f4c4029b962aae77b7cc0df/users/35df23814179489e98d15e5e38118de8/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.861173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5b0ab04f4c4029b962aae77b7cc0df, user_id=35df23814179489e98d15e5e38118de8, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:30.863876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:30.875069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1190/2371] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:30 2022] PUT /identity/v3/projects/4c5b0ab04f4c4029b962aae77b7cc0df/users/35df23814179489e98d15e5e38118de8/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:30.885856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ddab-dfb2-4831-83c3-7fbf69b19c7c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:30.886330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ddab-dfb2-4831-83c3-7fbf69b19c7c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:30.886448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ddab-dfb2-4831-83c3-7fbf69b19c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:30.914480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a446ddab-dfb2-4831-83c3-7fbf69b19c7c None None] MFA Rules not processed for user `35df23814179489e98d15e5e38118de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:30.915700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a446ddab-dfb2-4831-83c3-7fbf69b19c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:30.999827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1182/2372] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:31.011386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:31.013196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:31.077084 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03551c-957e-426f-84b9-dc61007bd34a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:31.080774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29cdc-873e-4948-b1d8-921f5629c25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:31.081406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29cdc-873e-4948-b1d8-921f5629c25e service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:31.081691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29cdc-873e-4948-b1d8-921f5629c25e service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:31.081965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29cdc-873e-4948-b1d8-921f5629c25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:31.090858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a29cdc-873e-4948-b1d8-921f5629c25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:31.092278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a29cdc-873e-4948-b1d8-921f5629c25e service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:31.101590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1191/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:31.181198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446ddab-dfb2-4831-83c3-7fbf69b19c7c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:31.191718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446ddab-dfb2-4831-83c3-7fbf69b19c7c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:31.195320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8793-d335-4c3a-a5aa-3ad6e774beb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:31.195916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8793-d335-4c3a-a5aa-3ad6e774beb0 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:31.196197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8793-d335-4c3a-a5aa-3ad6e774beb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:31.196471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8793-d335-4c3a-a5aa-3ad6e774beb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:31.253599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8793-d335-4c3a-a5aa-3ad6e774beb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:31.254991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8793-d335-4c3a-a5aa-3ad6e774beb0 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:31.263704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1183/2374] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:35.967149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29cdc-873e-4948-b1d8-921f5629c25e service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:36.032411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29cdc-873e-4948-b1d8-921f5629c25e service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:36.037338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:36.037966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:36.038426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:36.038730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] PATH_INFO: `/v3/users/29b322a984d146d3b79a1e21534a4ca2` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:36.039819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b322a984d146d3b79a1e21534a4ca2)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:36.041961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:36.087584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b322a984d146d3b79a1e21534a4ca2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.094598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b322a984d146d3b79a1e21534a4ca2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.095204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b322a984d146d3b79a1e21534a4ca2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.095805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b322a984d146d3b79a1e21534a4ca2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.108133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b322a984d146d3b79a1e21534a4ca2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.120680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1192/2375] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:35 2022] DELETE /identity/v3/users/29b322a984d146d3b79a1e21534a4ca2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:36.125132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49739eb-d3ae-4782-9c17-9f1fb6dcae38 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:36.125596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49739eb-d3ae-4782-9c17-9f1fb6dcae38 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:36.125734 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49739eb-d3ae-4782-9c17-9f1fb6dcae38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:36.144834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e49739eb-d3ae-4782-9c17-9f1fb6dcae38 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:36.146014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e49739eb-d3ae-4782-9c17-9f1fb6dcae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:36.202999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1184/2376] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:36.213079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:36.214553 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:36.229202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:36.274747 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b8fd4-59f2-47a1-9e84-f1e915354ca7 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:36.278362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95101-f565-4df5-80e0-bc0f48f9b19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:36.278954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95101-f565-4df5-80e0-bc0f48f9b19d service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:36.279228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95101-f565-4df5-80e0-bc0f48f9b19d service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:36.279495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95101-f565-4df5-80e0-bc0f48f9b19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:36.288202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95101-f565-4df5-80e0-bc0f48f9b19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:36.289552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95101-f565-4df5-80e0-bc0f48f9b19d service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:36.298847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1193/2377] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:36.566886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49739eb-d3ae-4782-9c17-9f1fb6dcae38 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:36.568300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e49739eb-d3ae-4782-9c17-9f1fb6dcae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:36.580414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49739eb-d3ae-4782-9c17-9f1fb6dcae38 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:36.585627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:36.586301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:36.586580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:36.586858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] PATH_INFO: `/v3/projects/1fa188afdd464bf3b85403d69b8bdc0e` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:36.587980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa188afdd464bf3b85403d69b8bdc0e)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:36.589898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:36.592422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:36.638594 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa188afdd464bf3b85403d69b8bdc0e', 'request_id': 'req-9b61ae56-3f71-4ab1-8bed-fa306ee62185'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.644332 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa188afdd464bf3b85403d69b8bdc0e', 'request_id': 'req-9b61ae56-3f71-4ab1-8bed-fa306ee62185'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.650388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa188afdd464bf3b85403d69b8bdc0e', 'request_id': 'req-9b61ae56-3f71-4ab1-8bed-fa306ee62185'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.663071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] The token cache is being invalidate because project 1fa188afdd464bf3b85403d69b8bdc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:36.663367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.664044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.665558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1185/2378] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:36 2022] DELETE /identity/v3/projects/1fa188afdd464bf3b85403d69b8bdc0e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:36.669753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95101-f565-4df5-80e0-bc0f48f9b19d service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:36.680046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95101-f565-4df5-80e0-bc0f48f9b19d service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:36.734758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:36.735380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:36.735659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:36.735930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] PATH_INFO: `/v3/users/35df23814179489e98d15e5e38118de8` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:36.737640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35df23814179489e98d15e5e38118de8)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:36.739592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:36.784812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35df23814179489e98d15e5e38118de8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.791538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35df23814179489e98d15e5e38118de8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.792171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35df23814179489e98d15e5e38118de8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.792764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35df23814179489e98d15e5e38118de8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.804749 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ed189379-6739-4a19-9129-1e09f97a0fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35df23814179489e98d15e5e38118de8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:36.817984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1194/2379] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:36 2022] DELETE /identity/v3/users/35df23814179489e98d15e5e38118de8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:37.102771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:37.104238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:37.117979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61ae56-3f71-4ab1-8bed-fa306ee62185 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:37.175657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:37.176380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.176664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.176942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] PATH_INFO: `/v3/projects/4c5b0ab04f4c4029b962aae77b7cc0df` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.178048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5b0ab04f4c4029b962aae77b7cc0df)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:37.179995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:37.351777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5b0ab04f4c4029b962aae77b7cc0df', 'request_id': 'req-8bf28171-a124-4e98-895c-be782bf029f6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:37.357242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5b0ab04f4c4029b962aae77b7cc0df', 'request_id': 'req-8bf28171-a124-4e98-895c-be782bf029f6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:37.364187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5b0ab04f4c4029b962aae77b7cc0df', 'request_id': 'req-8bf28171-a124-4e98-895c-be782bf029f6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:37.376486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] The token cache is being invalidate because project 4c5b0ab04f4c4029b962aae77b7cc0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:37.376776 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:37.377413 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8bf28171-a124-4e98-895c-be782bf029f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:37.378926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1186/2380] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:37 2022] DELETE /identity/v3/projects/4c5b0ab04f4c4029b962aae77b7cc0df => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:37.383719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091ed83-87ff-4554-9f25-b0257c5916b7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.384170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091ed83-87ff-4554-9f25-b0257c5916b7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.384281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091ed83-87ff-4554-9f25-b0257c5916b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.403728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4091ed83-87ff-4554-9f25-b0257c5916b7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:37.404921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4091ed83-87ff-4554-9f25-b0257c5916b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:37.436295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:37.467269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1195/2381] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:37.476574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8cc1-47d0-435b-87f7-446ab4417905 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.476864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8cc1-47d0-435b-87f7-446ab4417905 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.477190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8cc1-47d0-435b-87f7-446ab4417905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.496571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-25bd8cc1-47d0-435b-87f7-446ab4417905 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:37.497761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-25bd8cc1-47d0-435b-87f7-446ab4417905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:37.505534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1187/2382] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:37.509625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091ed83-87ff-4554-9f25-b0257c5916b7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:37.519432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091ed83-87ff-4554-9f25-b0257c5916b7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:37.523938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:37.524521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.524798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.525067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.525703 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:35:37.526006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:37.527621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:37.539426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1196/2383] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:35:37.543588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd8cc1-47d0-435b-87f7-446ab4417905 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:37.553092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd8cc1-47d0-435b-87f7-446ab4417905 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:37.558208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189e46-6a3a-4336-8323-f40c185067db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:37.558799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189e46-6a3a-4336-8323-f40c185067db admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.559077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189e46-6a3a-4336-8323-f40c185067db admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.559347 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189e46-6a3a-4336-8323-f40c185067db admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.559958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189e46-6a3a-4336-8323-f40c185067db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:37.561844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189e46-6a3a-4336-8323-f40c185067db admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:37.576109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:37.590596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1188/2384] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:37 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:37.594930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:37.606458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6409f4-df06-4813-8efa-69ad4ae149bf admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:37.666101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2b368-bb3b-4357-af12-26b2d1f49778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:37.666712 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2b368-bb3b-4357-af12-26b2d1f49778 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.666991 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2b368-bb3b-4357-af12-26b2d1f49778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.667260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2b368-bb3b-4357-af12-26b2d1f49778 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.667907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2b368-bb3b-4357-af12-26b2d1f49778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:37.669912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2b368-bb3b-4357-af12-26b2d1f49778 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:37.694369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1197/2385] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:37 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:37.698832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189e46-6a3a-4336-8323-f40c185067db admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:37.710284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189e46-6a3a-4336-8323-f40c185067db admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:37.715184 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7016-e2f4-42f4-b70c-a23b1888f0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:37.715786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7016-e2f4-42f4-b70c-a23b1888f0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.716070 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7016-e2f4-42f4-b70c-a23b1888f0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.716345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7016-e2f4-42f4-b70c-a23b1888f0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.717022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b7016-e2f4-42f4-b70c-a23b1888f0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:37.718646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b7016-e2f4-42f4-b70c-a23b1888f0c8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:37.729900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1189/2386] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:37.733906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2b368-bb3b-4357-af12-26b2d1f49778 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:37.744142 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2b368-bb3b-4357-af12-26b2d1f49778 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:37.748707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2674af9-4e93-408d-8959-84864a0458c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:37.749292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2674af9-4e93-408d-8959-84864a0458c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.749568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2674af9-4e93-408d-8959-84864a0458c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.749837 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2674af9-4e93-408d-8959-84864a0458c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.750498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2674af9-4e93-408d-8959-84864a0458c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:37.752342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2674af9-4e93-408d-8959-84864a0458c5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:37.763705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1198/2387] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:37.768476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7016-e2f4-42f4-b70c-a23b1888f0c8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:37.778455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7016-e2f4-42f4-b70c-a23b1888f0c8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:37.783167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d7198-ff7e-4121-be26-fda11233c4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:37.784413 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d7198-ff7e-4121-be26-fda11233c4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.784695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d7198-ff7e-4121-be26-fda11233c4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.784998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d7198-ff7e-4121-be26-fda11233c4b6 admin admin] PATH_INFO: `/v3/projects/0441714cd5b34ee393f7f9d1136f0f20/users/64354787277548e6b44285e5c8b0a5a2/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.799141 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d7198-ff7e-4121-be26-fda11233c4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0441714cd5b34ee393f7f9d1136f0f20, user_id=64354787277548e6b44285e5c8b0a5a2, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:37.801782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d7198-ff7e-4121-be26-fda11233c4b6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:37.814620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1190/2388] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:37 2022] PUT /identity/v3/projects/0441714cd5b34ee393f7f9d1136f0f20/users/64354787277548e6b44285e5c8b0a5a2/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:35:37.824781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2eaea-b98c-44da-b55b-03fb7af63dd4 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.825072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2eaea-b98c-44da-b55b-03fb7af63dd4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.825359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2eaea-b98c-44da-b55b-03fb7af63dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.852562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-45f2eaea-b98c-44da-b55b-03fb7af63dd4 None None] MFA Rules not processed for user `64354787277548e6b44285e5c8b0a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:37.853763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-45f2eaea-b98c-44da-b55b-03fb7af63dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:37.916429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1199/2389] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:37.920928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d7198-ff7e-4121-be26-fda11233c4b6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:37.981869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d7198-ff7e-4121-be26-fda11233c4b6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:37.987108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e10d3-719f-48a5-bbbf-f063426ebe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:37.987748 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e10d3-719f-48a5-bbbf-f063426ebe71 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:37.988031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e10d3-719f-48a5-bbbf-f063426ebe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:37.988305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e10d3-719f-48a5-bbbf-f063426ebe71 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:37.988930 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e10d3-719f-48a5-bbbf-f063426ebe71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:37.990865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e10d3-719f-48a5-bbbf-f063426ebe71 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:38.018591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1191/2390] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:37 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:35:38.022701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2eaea-b98c-44da-b55b-03fb7af63dd4 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:38.033266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2eaea-b98c-44da-b55b-03fb7af63dd4 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:38.062538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:38.090165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c8a72-593f-4663-ae82-0114bfd15bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:38.090766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8a72-593f-4663-ae82-0114bfd15bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:38.091052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8a72-593f-4663-ae82-0114bfd15bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:38.091332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8a72-593f-4663-ae82-0114bfd15bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:38.091959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c8a72-593f-4663-ae82-0114bfd15bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:38.093921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c8a72-593f-4663-ae82-0114bfd15bf0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:38.114014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1200/2391] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:38 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:38.117959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e10d3-719f-48a5-bbbf-f063426ebe71 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:38.128527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e10d3-719f-48a5-bbbf-f063426ebe71 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:38.133060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acd6a4-3ab5-4592-b3e1-509a059eb789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:38.133642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acd6a4-3ab5-4592-b3e1-509a059eb789 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:38.133921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acd6a4-3ab5-4592-b3e1-509a059eb789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:38.134230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acd6a4-3ab5-4592-b3e1-509a059eb789 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:38.134865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3acd6a4-3ab5-4592-b3e1-509a059eb789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:38.136446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3acd6a4-3ab5-4592-b3e1-509a059eb789 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:38.146680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1192/2392] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:38.150509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c8a72-593f-4663-ae82-0114bfd15bf0 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:38.160471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c8a72-593f-4663-ae82-0114bfd15bf0 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:38.165089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf125d-b210-407d-8396-3cc3aa5da2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:38.165737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf125d-b210-407d-8396-3cc3aa5da2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:38.166019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf125d-b210-407d-8396-3cc3aa5da2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:38.166334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf125d-b210-407d-8396-3cc3aa5da2d8 admin admin] PATH_INFO: `/v3/projects/e6035315cf974b85b4c08fcce700fbab/users/f46d274a95ad48e9a641ab6024d48d85/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:38.180927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf125d-b210-407d-8396-3cc3aa5da2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6035315cf974b85b4c08fcce700fbab, user_id=f46d274a95ad48e9a641ab6024d48d85, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:38.183565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf125d-b210-407d-8396-3cc3aa5da2d8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:38.196650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1201/2393] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:38 2022] PUT /identity/v3/projects/e6035315cf974b85b4c08fcce700fbab/users/f46d274a95ad48e9a641ab6024d48d85/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:38.200573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acd6a4-3ab5-4592-b3e1-509a059eb789 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:38.211155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acd6a4-3ab5-4592-b3e1-509a059eb789 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:38.265796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f03d8-3eee-4511-b4a2-8e318c353372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:38.266438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f03d8-3eee-4511-b4a2-8e318c353372 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:38.266717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f03d8-3eee-4511-b4a2-8e318c353372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:38.266992 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f03d8-3eee-4511-b4a2-8e318c353372 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:38.267650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f03d8-3eee-4511-b4a2-8e318c353372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:38.270088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f03d8-3eee-4511-b4a2-8e318c353372 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:38.279685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1193/2394] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:38.283763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf125d-b210-407d-8396-3cc3aa5da2d8 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:38.293993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf125d-b210-407d-8396-3cc3aa5da2d8 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:38.298643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:38.299854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:38.300127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:38.300397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] PATH_INFO: `/v3/projects/e6035315cf974b85b4c08fcce700fbab/users/f46d274a95ad48e9a641ab6024d48d85/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:38.302341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6035315cf974b85b4c08fcce700fbab, user_id=f46d274a95ad48e9a641ab6024d48d85, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:38.304959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:38.315037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1202/2395] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:38 2022] PUT /identity/v3/projects/e6035315cf974b85b4c08fcce700fbab/users/f46d274a95ad48e9a641ab6024d48d85/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:38.325102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75211-5503-481e-a83c-e08b760d2c01 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:38.325390 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75211-5503-481e-a83c-e08b760d2c01 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:38.325661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75211-5503-481e-a83c-e08b760d2c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:38.354811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-d4b75211-5503-481e-a83c-e08b760d2c01 None None] MFA Rules not processed for user `f46d274a95ad48e9a641ab6024d48d85`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:38.356012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d4b75211-5503-481e-a83c-e08b760d2c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:38.371768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:38.423681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1194/2396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:38.435037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:38.436682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:38.494685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d5279-e93a-4868-b7a8-acafeb3924d8 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:38.498324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f1617-541a-48bb-bc9d-90ca97bda1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:38.498916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f1617-541a-48bb-bc9d-90ca97bda1ce service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:38.499197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f1617-541a-48bb-bc9d-90ca97bda1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:38.499469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f1617-541a-48bb-bc9d-90ca97bda1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:38.508144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f1617-541a-48bb-bc9d-90ca97bda1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:38.509551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f1617-541a-48bb-bc9d-90ca97bda1ce service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:38.519604 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1203/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:38.591446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b75211-5503-481e-a83c-e08b760d2c01 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:38.600876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b75211-5503-481e-a83c-e08b760d2c01 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:38.604451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8949025-288d-48cb-b4b6-da568567c84c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:38.605037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949025-288d-48cb-b4b6-da568567c84c service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:38.605316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949025-288d-48cb-b4b6-da568567c84c service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:38.605586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949025-288d-48cb-b4b6-da568567c84c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:38.662418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8949025-288d-48cb-b4b6-da568567c84c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:38.663840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8949025-288d-48cb-b4b6-da568567c84c service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:38.672504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1195/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:38.938819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f1617-541a-48bb-bc9d-90ca97bda1ce service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:39.000262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f1617-541a-48bb-bc9d-90ca97bda1ce service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:39.004798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:39.005395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:39.005672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:39.005943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] PATH_INFO: `/v3/users/64354787277548e6b44285e5c8b0a5a2` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:39.007068 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64354787277548e6b44285e5c8b0a5a2)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:39.008973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:39.038415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:39.057881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64354787277548e6b44285e5c8b0a5a2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.064424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64354787277548e6b44285e5c8b0a5a2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.065184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64354787277548e6b44285e5c8b0a5a2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.065786 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64354787277548e6b44285e5c8b0a5a2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.077540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64354787277548e6b44285e5c8b0a5a2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.110354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1204/2399] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:38 2022] DELETE /identity/v3/users/64354787277548e6b44285e5c8b0a5a2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:39.114931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ea37-8955-4481-996f-0c72af7d681e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:39.115245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ea37-8955-4481-996f-0c72af7d681e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:39.115517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ea37-8955-4481-996f-0c72af7d681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:39.139260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-4e83ea37-8955-4481-996f-0c72af7d681e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:39.140456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4e83ea37-8955-4481-996f-0c72af7d681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:39.196475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1196/2400] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:39.206487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:39.207875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:39.264424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4e489-e912-4397-8608-fc5e49f446b0 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:39.268743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec6c98-0817-41c6-b559-326333a269bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:39.269342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6c98-0817-41c6-b559-326333a269bf service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:39.269622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6c98-0817-41c6-b559-326333a269bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:39.269894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6c98-0817-41c6-b559-326333a269bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:39.278759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec6c98-0817-41c6-b559-326333a269bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:39.280175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec6c98-0817-41c6-b559-326333a269bf service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:39.290129 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1205/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:39.554405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ea37-8955-4481-996f-0c72af7d681e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:39.555938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4e83ea37-8955-4481-996f-0c72af7d681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:39.568978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ea37-8955-4481-996f-0c72af7d681e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:39.573714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:39.574477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:39.574847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:39.575136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] PATH_INFO: `/v3/projects/0441714cd5b34ee393f7f9d1136f0f20` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:39.576264 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0441714cd5b34ee393f7f9d1136f0f20)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:39.578215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:39.623429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:39.624687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0441714cd5b34ee393f7f9d1136f0f20', 'request_id': 'req-1a66d77d-66a4-4982-90a1-a4ce6b30512c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.631767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0441714cd5b34ee393f7f9d1136f0f20', 'request_id': 'req-1a66d77d-66a4-4982-90a1-a4ce6b30512c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.637790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0441714cd5b34ee393f7f9d1136f0f20', 'request_id': 'req-1a66d77d-66a4-4982-90a1-a4ce6b30512c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.650561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] The token cache is being invalidate because project 0441714cd5b34ee393f7f9d1136f0f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:39.650850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.651463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.652909 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1197/2402] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:39 2022] DELETE /identity/v3/projects/0441714cd5b34ee393f7f9d1136f0f20 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:39.656915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec6c98-0817-41c6-b559-326333a269bf service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:39.666583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec6c98-0817-41c6-b559-326333a269bf service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:39.723081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:39.723708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:39.723995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:39.724271 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] PATH_INFO: `/v3/users/f46d274a95ad48e9a641ab6024d48d85` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:39.725403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46d274a95ad48e9a641ab6024d48d85)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:39.727348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:39.772567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46d274a95ad48e9a641ab6024d48d85'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.775077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:39.780790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46d274a95ad48e9a641ab6024d48d85'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.781461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46d274a95ad48e9a641ab6024d48d85'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.782322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46d274a95ad48e9a641ab6024d48d85'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.799969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b795474d-e65c-41f6-820d-e5fb8cecccd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46d274a95ad48e9a641ab6024d48d85'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:39.812039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1206/2403] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:39 2022] DELETE /identity/v3/users/f46d274a95ad48e9a641ab6024d48d85 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:40.081562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.083152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:40.100786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d77d-66a4-4982-90a1-a4ce6b30512c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.157470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.158112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.158425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.158773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] PATH_INFO: `/v3/projects/e6035315cf974b85b4c08fcce700fbab` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.159870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6035315cf974b85b4c08fcce700fbab)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:40.161750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:40.205968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6035315cf974b85b4c08fcce700fbab', 'request_id': 'req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:40.211335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6035315cf974b85b4c08fcce700fbab', 'request_id': 'req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:40.217771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6035315cf974b85b4c08fcce700fbab', 'request_id': 'req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:40.229975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] The token cache is being invalidate because project e6035315cf974b85b4c08fcce700fbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:40.230295 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:40.230911 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9f2403ba-7af6-4f68-a539-fd9502e2cdf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:40.232336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1198/2404] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:40 2022] DELETE /identity/v3/projects/e6035315cf974b85b4c08fcce700fbab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:40.237765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9561ea-e7a2-4034-9b57-83f47225e1e6 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.238054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9561ea-e7a2-4034-9b57-83f47225e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.238375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9561ea-e7a2-4034-9b57-83f47225e1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.257265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-1b9561ea-e7a2-4034-9b57-83f47225e1e6 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:40.258499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1b9561ea-e7a2-4034-9b57-83f47225e1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:40.315852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1207/2405] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:40.379467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e120e46-85bc-4904-82bc-bb926098d83b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.379819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e120e46-85bc-4904-82bc-bb926098d83b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.380131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e120e46-85bc-4904-82bc-bb926098d83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.400869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8e120e46-85bc-4904-82bc-bb926098d83b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:40.402099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8e120e46-85bc-4904-82bc-bb926098d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:40.409957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1199/2406] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:40.414162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9561ea-e7a2-4034-9b57-83f47225e1e6 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.423740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9561ea-e7a2-4034-9b57-83f47225e1e6 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.428320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.428910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.429190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.429465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.430127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:35:40.430435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:40.432002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:40.443752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1208/2407] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:35:40.447695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e120e46-85bc-4904-82bc-bb926098d83b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.457199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e120e46-85bc-4904-82bc-bb926098d83b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.461743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e057c-c7f3-4c2c-9fa9-dd60fc368bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.462359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e057c-c7f3-4c2c-9fa9-dd60fc368bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.462640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e057c-c7f3-4c2c-9fa9-dd60fc368bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.462910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e057c-c7f3-4c2c-9fa9-dd60fc368bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.463529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e057c-c7f3-4c2c-9fa9-dd60fc368bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:40.465403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e057c-c7f3-4c2c-9fa9-dd60fc368bc9 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:40.491269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1200/2408] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:40 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:35:40.495250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.505602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8040e4f-dab9-4e3a-b27a-b7a45c6be69d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.561629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b7a83-4c0f-477c-9737-0446b450c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.562264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7a83-4c0f-477c-9737-0446b450c702 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.562544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7a83-4c0f-477c-9737-0446b450c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.562813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7a83-4c0f-477c-9737-0446b450c702 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.563430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b7a83-4c0f-477c-9737-0446b450c702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:40.565921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b7a83-4c0f-477c-9737-0446b450c702 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:40.587864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1209/2409] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:40 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:40.592140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e057c-c7f3-4c2c-9fa9-dd60fc368bc9 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.602595 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e057c-c7f3-4c2c-9fa9-dd60fc368bc9 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.607181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108444-fde6-45cf-b228-281608f306ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.607766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108444-fde6-45cf-b228-281608f306ac admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.608045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108444-fde6-45cf-b228-281608f306ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.608319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108444-fde6-45cf-b228-281608f306ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.608951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36108444-fde6-45cf-b228-281608f306ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:40.610675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36108444-fde6-45cf-b228-281608f306ac admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:40.621001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1201/2410] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:40.624952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b7a83-4c0f-477c-9737-0446b450c702 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.635372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b7a83-4c0f-477c-9737-0446b450c702 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.639837 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8b41c-6069-4827-a59e-e767c05f8d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.640414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b41c-6069-4827-a59e-e767c05f8d2f admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.640694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b41c-6069-4827-a59e-e767c05f8d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.640963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b41c-6069-4827-a59e-e767c05f8d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.641594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8b41c-6069-4827-a59e-e767c05f8d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:40.643536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8b41c-6069-4827-a59e-e767c05f8d2f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:40.654152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1210/2411] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:40.658009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108444-fde6-45cf-b228-281608f306ac admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.667847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108444-fde6-45cf-b228-281608f306ac admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.672585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cc5d4-de21-4e10-9903-0f87c9c262a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.673253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cc5d4-de21-4e10-9903-0f87c9c262a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.673533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cc5d4-de21-4e10-9903-0f87c9c262a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.674345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cc5d4-de21-4e10-9903-0f87c9c262a4 admin admin] PATH_INFO: `/v3/projects/1da9aee8d3fb46faaaac246435f3e10c/users/88ba8455e3c240ec80bbf7828bcb3d8b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.688500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cc5d4-de21-4e10-9903-0f87c9c262a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da9aee8d3fb46faaaac246435f3e10c, user_id=88ba8455e3c240ec80bbf7828bcb3d8b, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:40.691819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cc5d4-de21-4e10-9903-0f87c9c262a4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:40.704891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1202/2412] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:40 2022] PUT /identity/v3/projects/1da9aee8d3fb46faaaac246435f3e10c/users/88ba8455e3c240ec80bbf7828bcb3d8b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:40.715099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee91e6-d2af-413c-ac48-9298e3d9e615 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.715594 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee91e6-d2af-413c-ac48-9298e3d9e615 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.715919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee91e6-d2af-413c-ac48-9298e3d9e615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.743491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-0eee91e6-d2af-413c-ac48-9298e3d9e615 None None] MFA Rules not processed for user `88ba8455e3c240ec80bbf7828bcb3d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:40.744676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0eee91e6-d2af-413c-ac48-9298e3d9e615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:40.764624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:40.820549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1211/2413] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:40.825096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cc5d4-de21-4e10-9903-0f87c9c262a4 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.829585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:40.888718 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cc5d4-de21-4e10-9903-0f87c9c262a4 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.894079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0259c8-59ac-476f-81e0-f78b2c4756d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.894697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0259c8-59ac-476f-81e0-f78b2c4756d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.894979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0259c8-59ac-476f-81e0-f78b2c4756d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.896089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0259c8-59ac-476f-81e0-f78b2c4756d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:40.896719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0259c8-59ac-476f-81e0-f78b2c4756d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:40.898673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0259c8-59ac-476f-81e0-f78b2c4756d0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:40.925410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1203/2414] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:40 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:40.929489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee91e6-d2af-413c-ac48-9298e3d9e615 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:40.940813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee91e6-d2af-413c-ac48-9298e3d9e615 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:40.998715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285818e3-23ae-4f6a-8598-129a9684c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:40.999384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285818e3-23ae-4f6a-8598-129a9684c893 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:40.999693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285818e3-23ae-4f6a-8598-129a9684c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:40.999982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285818e3-23ae-4f6a-8598-129a9684c893 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:41.000692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285818e3-23ae-4f6a-8598-129a9684c893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:41.002735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285818e3-23ae-4f6a-8598-129a9684c893 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:41.023356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1212/2415] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:40 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:41.027418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0259c8-59ac-476f-81e0-f78b2c4756d0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:41.038512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0259c8-59ac-476f-81e0-f78b2c4756d0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:41.048496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1ecd8-2f96-4628-bb6e-654c905cbd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:41.049712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ecd8-2f96-4628-bb6e-654c905cbd60 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:41.049999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ecd8-2f96-4628-bb6e-654c905cbd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:41.050306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ecd8-2f96-4628-bb6e-654c905cbd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:41.050956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1ecd8-2f96-4628-bb6e-654c905cbd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:41.052571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1ecd8-2f96-4628-bb6e-654c905cbd60 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:41.063427 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1204/2416] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:41.067838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285818e3-23ae-4f6a-8598-129a9684c893 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:41.077718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285818e3-23ae-4f6a-8598-129a9684c893 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:41.082438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4eb9dc-7aeb-4f3d-a187-a0ccb240d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:41.083085 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb9dc-7aeb-4f3d-a187-a0ccb240d137 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:41.083369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb9dc-7aeb-4f3d-a187-a0ccb240d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:41.083650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb9dc-7aeb-4f3d-a187-a0ccb240d137 admin admin] PATH_INFO: `/v3/projects/2ab2114c138c48d58c7c32a321e94de9/users/b4d47feec33a497590a301d72e781bf7/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:41.100218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eb9dc-7aeb-4f3d-a187-a0ccb240d137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab2114c138c48d58c7c32a321e94de9, user_id=b4d47feec33a497590a301d72e781bf7, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:41.102969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eb9dc-7aeb-4f3d-a187-a0ccb240d137 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:41.124931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1213/2417] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:41 2022] PUT /identity/v3/projects/2ab2114c138c48d58c7c32a321e94de9/users/b4d47feec33a497590a301d72e781bf7/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:41.130087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1ecd8-2f96-4628-bb6e-654c905cbd60 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:41.140024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1ecd8-2f96-4628-bb6e-654c905cbd60 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:41.194970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1db6e6-1e18-4826-86dc-b9c4a7c0de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:41.195563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db6e6-1e18-4826-86dc-b9c4a7c0de08 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:41.195843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db6e6-1e18-4826-86dc-b9c4a7c0de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:41.196134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1db6e6-1e18-4826-86dc-b9c4a7c0de08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:41.196783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1db6e6-1e18-4826-86dc-b9c4a7c0de08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:41.198402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1db6e6-1e18-4826-86dc-b9c4a7c0de08 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:41.207808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1205/2418] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:35:41.211980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4eb9dc-7aeb-4f3d-a187-a0ccb240d137 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:41.222755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4eb9dc-7aeb-4f3d-a187-a0ccb240d137 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:41.227267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:41.227974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:41.228256 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:41.228526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] PATH_INFO: `/v3/projects/2ab2114c138c48d58c7c32a321e94de9/users/b4d47feec33a497590a301d72e781bf7/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:41.230441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab2114c138c48d58c7c32a321e94de9, user_id=b4d47feec33a497590a301d72e781bf7, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:41.233115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:41.243639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1214/2419] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:41 2022] PUT /identity/v3/projects/2ab2114c138c48d58c7c32a321e94de9/users/b4d47feec33a497590a301d72e781bf7/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:35:41.254767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b665-7b30-4ea8-aa6f-c0d6dab7b683 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:41.255056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b665-7b30-4ea8-aa6f-c0d6dab7b683 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:41.255334 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b665-7b30-4ea8-aa6f-c0d6dab7b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:41.282581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-5cd4b665-7b30-4ea8-aa6f-c0d6dab7b683 None None] MFA Rules not processed for user `b4d47feec33a497590a301d72e781bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:41.284305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5cd4b665-7b30-4ea8-aa6f-c0d6dab7b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:41.344830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:41.351632 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1206/2420] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:41.361895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:41.363612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:41.419899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5c10-28be-4704-bc7f-bdd500aab4c4 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:41.423464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7fa5b-0e22-4067-b907-98693506a0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:41.424089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fa5b-0e22-4067-b907-98693506a0aa service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:41.424364 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fa5b-0e22-4067-b907-98693506a0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:41.424631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fa5b-0e22-4067-b907-98693506a0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:41.453143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:41.485220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7fa5b-0e22-4067-b907-98693506a0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:41.486722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7fa5b-0e22-4067-b907-98693506a0aa service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:41.495489 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1215/2421] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:44.018668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4b665-7b30-4ea8-aa6f-c0d6dab7b683 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:44.083060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4b665-7b30-4ea8-aa6f-c0d6dab7b683 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:44.087499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:44.088122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:44.088405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:44.088682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] PATH_INFO: `/v3/users/88ba8455e3c240ec80bbf7828bcb3d8b` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:44.089803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ba8455e3c240ec80bbf7828bcb3d8b)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:44.091759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:44.136654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ba8455e3c240ec80bbf7828bcb3d8b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.143504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ba8455e3c240ec80bbf7828bcb3d8b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.144129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ba8455e3c240ec80bbf7828bcb3d8b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.153230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ba8455e3c240ec80bbf7828bcb3d8b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.168712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ba8455e3c240ec80bbf7828bcb3d8b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.175169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1207/2422] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:44 2022] DELETE /identity/v3/users/88ba8455e3c240ec80bbf7828bcb3d8b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:44.179721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db80f-79c8-4032-91f4-e7177a562af7 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:44.180356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db80f-79c8-4032-91f4-e7177a562af7 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:44.180356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db80f-79c8-4032-91f4-e7177a562af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:44.198680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9e9db80f-79c8-4032-91f4-e7177a562af7 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:44.199940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9e9db80f-79c8-4032-91f4-e7177a562af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:44.258086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1216/2423] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:44.267830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:44.269504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:44.325732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dce5-e9b9-4b86-ada1-65aae2831677 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:44.329415 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb4ec8-6341-46a9-b623-d41af46f4545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:44.330543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb4ec8-6341-46a9-b623-d41af46f4545 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:44.330825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb4ec8-6341-46a9-b623-d41af46f4545 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:44.331096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb4ec8-6341-46a9-b623-d41af46f4545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:44.340197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb4ec8-6341-46a9-b623-d41af46f4545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:44.341554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb4ec8-6341-46a9-b623-d41af46f4545 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:44.351379 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1208/2424] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:44.619054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db80f-79c8-4032-91f4-e7177a562af7 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:44.620906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9e9db80f-79c8-4032-91f4-e7177a562af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:44.632954 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db80f-79c8-4032-91f4-e7177a562af7 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:44.637475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:44.638194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:44.638482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:44.638755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] PATH_INFO: `/v3/projects/1da9aee8d3fb46faaaac246435f3e10c` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:44.639876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da9aee8d3fb46faaaac246435f3e10c)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:44.641758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:44.690259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da9aee8d3fb46faaaac246435f3e10c', 'request_id': 'req-8575813d-e474-4ecd-9dbd-a09a73ed31bb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.695621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da9aee8d3fb46faaaac246435f3e10c', 'request_id': 'req-8575813d-e474-4ecd-9dbd-a09a73ed31bb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.701615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da9aee8d3fb46faaaac246435f3e10c', 'request_id': 'req-8575813d-e474-4ecd-9dbd-a09a73ed31bb'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.714135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] The token cache is being invalidate because project 1da9aee8d3fb46faaaac246435f3e10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:44.714505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.715118 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.716740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1217/2425] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:44 2022] DELETE /identity/v3/projects/1da9aee8d3fb46faaaac246435f3e10c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:44.721249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb4ec8-6341-46a9-b623-d41af46f4545 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:44.731066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb4ec8-6341-46a9-b623-d41af46f4545 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:44.747431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:44.789009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:44.789630 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:44.789907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:44.790206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] PATH_INFO: `/v3/users/b4d47feec33a497590a301d72e781bf7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:44.791320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d47feec33a497590a301d72e781bf7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:44.793220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:44.845148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d47feec33a497590a301d72e781bf7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.852900 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d47feec33a497590a301d72e781bf7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.853616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d47feec33a497590a301d72e781bf7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.861967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d47feec33a497590a301d72e781bf7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.873528 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ea829151-6464-4eef-97eb-5ffde17f9198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d47feec33a497590a301d72e781bf7'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:44.879840 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1209/2426] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:35:44 2022] DELETE /identity/v3/users/b4d47feec33a497590a301d72e781bf7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:45.146646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:45.148078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:45.162649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575813d-e474-4ecd-9dbd-a09a73ed31bb admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:45.211502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:45.223127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:45.223890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.224739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.225022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] PATH_INFO: `/v3/projects/2ab2114c138c48d58c7c32a321e94de9` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.226251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab2114c138c48d58c7c32a321e94de9)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:45.228173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:45.275716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab2114c138c48d58c7c32a321e94de9', 'request_id': 'req-421f63fb-c1ef-4468-8037-8e31e00386e7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:45.283423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab2114c138c48d58c7c32a321e94de9', 'request_id': 'req-421f63fb-c1ef-4468-8037-8e31e00386e7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:45.289842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab2114c138c48d58c7c32a321e94de9', 'request_id': 'req-421f63fb-c1ef-4468-8037-8e31e00386e7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:45.302886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] The token cache is being invalidate because project 2ab2114c138c48d58c7c32a321e94de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:35:45.303334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:45.303980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-421f63fb-c1ef-4468-8037-8e31e00386e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:35:45.305577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1218/2427] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:35:45 2022] DELETE /identity/v3/projects/2ab2114c138c48d58c7c32a321e94de9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:45.310552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe024-39e4-4ab6-9b2d-93bdac7c38ab None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.310987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe024-39e4-4ab6-9b2d-93bdac7c38ab None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.311102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe024-39e4-4ab6-9b2d-93bdac7c38ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.331069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8bbbe024-39e4-4ab6-9b2d-93bdac7c38ab None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:45.332250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8bbbe024-39e4-4ab6-9b2d-93bdac7c38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:45.388702 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1210/2428] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:45.396450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeee14-9f4b-474f-9321-b852760094c1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.396738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeee14-9f4b-474f-9321-b852760094c1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.397009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeee14-9f4b-474f-9321-b852760094c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.415910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-2aeeee14-9f4b-474f-9321-b852760094c1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:45.417089 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2aeeee14-9f4b-474f-9321-b852760094c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:45.425315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1219/2429] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:35:45.429360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe024-39e4-4ab6-9b2d-93bdac7c38ab None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:45.439103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe024-39e4-4ab6-9b2d-93bdac7c38ab None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:45.444583 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:45.445165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.445476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.445744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.446491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:35:45.446716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:45.448311 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:45.459775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1211/2430] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:35:45.464079 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeeee14-9f4b-474f-9321-b852760094c1 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:45.473802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeeee14-9f4b-474f-9321-b852760094c1 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:45.478402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2163f-3e2d-40f6-93eb-557f7c22c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:45.478986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2163f-3e2d-40f6-93eb-557f7c22c498 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.479264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2163f-3e2d-40f6-93eb-557f7c22c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.479534 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2163f-3e2d-40f6-93eb-557f7c22c498 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.480156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2163f-3e2d-40f6-93eb-557f7c22c498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:45.482028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2163f-3e2d-40f6-93eb-557f7c22c498 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:45.508463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1220/2431] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:35:45 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:35:45.512428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:45.522455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e2b5-3eca-47ba-87c0-8668f7ad1af0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:45.545887 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:45.578578 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490543f-29f5-44d2-8c24-450840b61e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:45.579168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490543f-29f5-44d2-8c24-450840b61e05 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.579445 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490543f-29f5-44d2-8c24-450840b61e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.579714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490543f-29f5-44d2-8c24-450840b61e05 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.580369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490543f-29f5-44d2-8c24-450840b61e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:45.582307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490543f-29f5-44d2-8c24-450840b61e05 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:45.602931 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1212/2432] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:35:45 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:35:45.607019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2163f-3e2d-40f6-93eb-557f7c22c498 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:45.617851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2163f-3e2d-40f6-93eb-557f7c22c498 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:45.622865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31e0c6-38cf-423a-ac3c-ab12dcea2dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:45.623451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31e0c6-38cf-423a-ac3c-ab12dcea2dba admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.623729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31e0c6-38cf-423a-ac3c-ab12dcea2dba admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.624002 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31e0c6-38cf-423a-ac3c-ab12dcea2dba admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.624664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31e0c6-38cf-423a-ac3c-ab12dcea2dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:45.626293 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31e0c6-38cf-423a-ac3c-ab12dcea2dba admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:45.636390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1221/2433] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:45.640235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490543f-29f5-44d2-8c24-450840b61e05 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:45.650103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490543f-29f5-44d2-8c24-450840b61e05 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:45.654627 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d101ca-f441-4d47-87de-52671c4db25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:45.655213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d101ca-f441-4d47-87de-52671c4db25b admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.655493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d101ca-f441-4d47-87de-52671c4db25b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.655769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d101ca-f441-4d47-87de-52671c4db25b admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.656401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d101ca-f441-4d47-87de-52671c4db25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:45.657977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d101ca-f441-4d47-87de-52671c4db25b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:45.668180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1213/2434] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:35:45.672013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31e0c6-38cf-423a-ac3c-ab12dcea2dba admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:45.682374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31e0c6-38cf-423a-ac3c-ab12dcea2dba admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:45.686943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:45.687572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.687852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.688127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] PATH_INFO: `/v3/projects/b2c2a3b447664dcba6c446c02d309ead/users/53cbef29ffff4e5dba193acbf0fe88ee/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.703297 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c2a3b447664dcba6c446c02d309ead, user_id=53cbef29ffff4e5dba193acbf0fe88ee, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:45.705988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:45.719345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1222/2435] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:35:45 2022] PUT /identity/v3/projects/b2c2a3b447664dcba6c446c02d309ead/users/53cbef29ffff4e5dba193acbf0fe88ee/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:35:45.730013 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a641e6-5dfe-4217-9b2f-0c55e0c36aa8 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.730330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a641e6-5dfe-4217-9b2f-0c55e0c36aa8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.730603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a641e6-5dfe-4217-9b2f-0c55e0c36aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.759525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-85a641e6-5dfe-4217-9b2f-0c55e0c36aa8 None None] MFA Rules not processed for user `53cbef29ffff4e5dba193acbf0fe88ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:35:45.760805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-85a641e6-5dfe-4217-9b2f-0c55e0c36aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:45.831442 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1214/2436] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:35:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:35:45.843784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:35:45.845476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:35:45.904926 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f22057-b725-44e2-999a-652dff70715d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:35:45.909018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4fc79-7871-4018-8237-83d213e696fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:35:45.909620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fc79-7871-4018-8237-83d213e696fa service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:35:45.909900 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fc79-7871-4018-8237-83d213e696fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:35:45.910204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fc79-7871-4018-8237-83d213e696fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:35:45.918357 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4fc79-7871-4018-8237-83d213e696fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:35:45.919775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4fc79-7871-4018-8237-83d213e696fa service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:35:45.928481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1223/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:35:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:35:55.828054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:55.925197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:00.798043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6935-696b-4296-a210-4f10cdd01fba None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:00.798537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6935-696b-4296-a210-4f10cdd01fba None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:00.798631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6935-696b-4296-a210-4f10cdd01fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:00.817532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-168b6935-696b-4296-a210-4f10cdd01fba None None] MFA Rules not processed for user `17cc8db0bbd24c4098931f2c53381751`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:36:00.818791 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-168b6935-696b-4296-a210-4f10cdd01fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:00.874494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1215/2438] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:36:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:36:10.867759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=25 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:17.811933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49871-3b12-4f53-91c5-17d9eed6e108 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:17.812426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49871-3b12-4f53-91c5-17d9eed6e108 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:17.812527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49871-3b12-4f53-91c5-17d9eed6e108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:17.833213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-abf49871-3b12-4f53-91c5-17d9eed6e108 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:36:17.834475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-abf49871-3b12-4f53-91c5-17d9eed6e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:17.890402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1224/2439] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:36:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:36:17.936486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b6935-696b-4296-a210-4f10cdd01fba None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:36:17.937882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-168b6935-696b-4296-a210-4f10cdd01fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:18.007001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b6935-696b-4296-a210-4f10cdd01fba None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:36:18.011891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd360d1-d501-4630-96e1-09f09627f2ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:36:18.012486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd360d1-d501-4630-96e1-09f09627f2ac service swift] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:18.012769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd360d1-d501-4630-96e1-09f09627f2ac service swift] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:18.013038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd360d1-d501-4630-96e1-09f09627f2ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:18.021827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd360d1-d501-4630-96e1-09f09627f2ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:36:18.023437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd360d1-d501-4630-96e1-09f09627f2ac service swift] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:36:18.031167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1216/2440] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:36:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:36:24.421535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49871-3b12-4f53-91c5-17d9eed6e108 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:36:24.489463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49871-3b12-4f53-91c5-17d9eed6e108 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:36:24.493930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:36:24.494605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:24.494882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:24.495150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] PATH_INFO: `/v3/users/53cbef29ffff4e5dba193acbf0fe88ee` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:24.496258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53cbef29ffff4e5dba193acbf0fe88ee)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:36:24.498231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:36:24.555787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53cbef29ffff4e5dba193acbf0fe88ee'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:24.565249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53cbef29ffff4e5dba193acbf0fe88ee'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:24.566138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53cbef29ffff4e5dba193acbf0fe88ee'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:24.566823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53cbef29ffff4e5dba193acbf0fe88ee'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:24.582517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53cbef29ffff4e5dba193acbf0fe88ee'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:24.600402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1225/2441] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:36:24 2022] DELETE /identity/v3/users/53cbef29ffff4e5dba193acbf0fe88ee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:36:24.602098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd61e-3021-4c7d-8343-c918bec99049 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:24.602558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd61e-3021-4c7d-8343-c918bec99049 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:24.602674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd61e-3021-4c7d-8343-c918bec99049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:24.621805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-9bccd61e-3021-4c7d-8343-c918bec99049 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:36:24.623062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9bccd61e-3021-4c7d-8343-c918bec99049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:24.693316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1217/2442] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:36:24.703739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:36:24.705794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:24.735229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:24.768252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b291-51dd-449a-8374-79b767d21364 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:36:24.771879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8100-b69c-4bab-941c-44e7a282df3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:36:24.772479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8100-b69c-4bab-941c-44e7a282df3f service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:24.772754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8100-b69c-4bab-941c-44e7a282df3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:24.773024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8100-b69c-4bab-941c-44e7a282df3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:24.782458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d8100-b69c-4bab-941c-44e7a282df3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:36:24.783884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d8100-b69c-4bab-941c-44e7a282df3f service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:36:24.794025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1226/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:36:25.224156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccd61e-3021-4c7d-8343-c918bec99049 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:36:25.225409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9bccd61e-3021-4c7d-8343-c918bec99049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:25.245604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccd61e-3021-4c7d-8343-c918bec99049 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:36:25.250626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:36:25.251342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:25.251723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:25.252096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] PATH_INFO: `/v3/projects/b2c2a3b447664dcba6c446c02d309ead` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:25.253392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c2a3b447664dcba6c446c02d309ead)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:36:25.255636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:36:25.313371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c2a3b447664dcba6c446c02d309ead', 'request_id': 'req-e7c1a408-1b5f-4924-92b2-2ed268490b28'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:25.320438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c2a3b447664dcba6c446c02d309ead', 'request_id': 'req-e7c1a408-1b5f-4924-92b2-2ed268490b28'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:25.327847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c2a3b447664dcba6c446c02d309ead', 'request_id': 'req-e7c1a408-1b5f-4924-92b2-2ed268490b28'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:25.342592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] The token cache is being invalidate because project b2c2a3b447664dcba6c446c02d309ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:36:25.342908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:25.343579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e7c1a408-1b5f-4924-92b2-2ed268490b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:36:25.345612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1218/2444] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:36:25 2022] DELETE /identity/v3/projects/b2c2a3b447664dcba6c446c02d309ead => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:36:34.300186 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c068-f305-4712-b437-c1140d263287 None None] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:34.300752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c068-f305-4712-b437-c1140d263287 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:34.301023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c068-f305-4712-b437-c1140d263287 None None] PATH_INFO: `/` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:34.302985 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1227/2445] 10.222.0.23 () {54 vars in 921 bytes} [Mon Aug 8 00:36:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 00:36:34.308022 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6d19-d81a-4c11-99eb-d69d3d309b63 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:34.308529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6d19-d81a-4c11-99eb-d69d3d309b63 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:34.308529 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6d19-d81a-4c11-99eb-d69d3d309b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:34.328483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:34.375336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-445c6d19-d81a-4c11-99eb-d69d3d309b63 None None] MFA Rules not processed for user `fe6573439abd4afb8098390eb4c7e5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:36:34.376545 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-445c6d19-d81a-4c11-99eb-d69d3d309b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:34.497362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1219/2446] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Aug 8 00:36:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:36:34.508540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c068-f305-4712-b437-c1140d263287 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:36:34.510269 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a2d8c068-f305-4712-b437-c1140d263287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:34.567909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c068-f305-4712-b437-c1140d263287 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:36:34.571471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d5fb05964b47d5a2f33fe9dde1f65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:36:34.572069 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:34.572351 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:34.572630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:34.583108 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:36:34.584538 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:36:34.596753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1228/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:36:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:36:37.066675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8095-5cce-44c6-8e15-473802c4a4f2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:37.067162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8095-5cce-44c6-8e15-473802c4a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:37.067261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8095-5cce-44c6-8e15-473802c4a4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:37.085696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-516d8095-5cce-44c6-8e15-473802c4a4f2 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:36:37.086935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-516d8095-5cce-44c6-8e15-473802c4a4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:37.141221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1220/2448] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:36:37.153169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:36:37.154586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:37.221298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa67820-3f39-442f-8a76-a61cd65a32d9 service glance] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:36:37.226239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbb97-0686-4b59-9a37-986aac2aed4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:36:37.226826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbb97-0686-4b59-9a37-986aac2aed4e service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:37.227103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbb97-0686-4b59-9a37-986aac2aed4e service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:37.227373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbb97-0686-4b59-9a37-986aac2aed4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:37.235080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcbb97-0686-4b59-9a37-986aac2aed4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:36:37.237243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcbb97-0686-4b59-9a37-986aac2aed4e service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:36:37.245026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1229/2449] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:36:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 00:36:47.134843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:47.241878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=73 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:59.697178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75c97c-149f-421d-b941-d319cdab3d03 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:59.697636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75c97c-149f-421d-b941-d319cdab3d03 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:59.697746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75c97c-149f-421d-b941-d319cdab3d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:59.716212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3e75c97c-149f-421d-b941-d319cdab3d03 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:36:59.717396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3e75c97c-149f-421d-b941-d319cdab3d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:36:59.725071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1221/2450] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 00:36:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:36:59.739360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbb97-0686-4b59-9a37-986aac2aed4e service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:36:59.750578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbb97-0686-4b59-9a37-986aac2aed4e service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:36:59.755731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:36:59.756330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:36:59.756613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:36:59.756889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:36:59.764992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:36:59.766598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:36:59.774852 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1230/2451] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:36:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:37:06.322449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75c97c-149f-421d-b941-d319cdab3d03 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:06.324144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3e75c97c-149f-421d-b941-d319cdab3d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:06.435653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75c97c-149f-421d-b941-d319cdab3d03 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:06.441898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:06.442554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:06.442833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:06.443102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:06.444933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:06.457688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:06.459354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:06.470944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1222/2452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:09.771794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=6 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:11.929449 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:11.930994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:12.011164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3503b-a4dc-41e7-af70-21adf2b05df9 service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:12.014963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:12.015616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:12.015898 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:12.016172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:12.018798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:12.106846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:12.108183 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:12.127834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1231/2453] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:15.274907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:15.276372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:15.289191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0b09-5012-4725-b9c1-82f747e5a819 service placement] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:15.294257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:15.294858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:15.295140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:15.295423 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:15.297165 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:15.309945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:15.311690 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:15.323349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1223/2454] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:15.328254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:15.329815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:15.344189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f110573-221b-4d1a-b4c7-c4316dc73dde service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:15.349686 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:15.350363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:15.350646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:15.350918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] PATH_INFO: `/v3/users/3e3151bac78942a69fb3764d5ef3814c` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:15.352146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3151bac78942a69fb3764d5ef3814c)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:15.354122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:15.401227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3151bac78942a69fb3764d5ef3814c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.408268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3151bac78942a69fb3764d5ef3814c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.408890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3151bac78942a69fb3764d5ef3814c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.409552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3151bac78942a69fb3764d5ef3814c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.411477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:15.424054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-90ab9e10-67f9-4e48-bb63-ba0d24cdac6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3151bac78942a69fb3764d5ef3814c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.436093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1232/2455] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:15 2022] DELETE /identity/v3/users/3e3151bac78942a69fb3764d5ef3814c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:15.605351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:15.617063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5be95-64c0-4b43-ae6b-a0437fcb1cad service placement] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:15.675399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:15.676026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:15.676309 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:15.676585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] PATH_INFO: `/v3/projects/66a34b0ac3e04b6aa593e8b6097a011e` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:15.677695 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a34b0ac3e04b6aa593e8b6097a011e)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:15.679633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:15.728672 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a34b0ac3e04b6aa593e8b6097a011e', 'request_id': 'req-ca947892-b66b-4576-9293-bb523c886252'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.730633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:15.735872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a34b0ac3e04b6aa593e8b6097a011e', 'request_id': 'req-ca947892-b66b-4576-9293-bb523c886252'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.742775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a34b0ac3e04b6aa593e8b6097a011e', 'request_id': 'req-ca947892-b66b-4576-9293-bb523c886252'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.754961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] The token cache is being invalidate because project 66a34b0ac3e04b6aa593e8b6097a011e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:15.755246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.755906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ca947892-b66b-4576-9293-bb523c886252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:15.757366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1224/2456] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:15 2022] DELETE /identity/v3/projects/66a34b0ac3e04b6aa593e8b6097a011e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:15.762417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ef42a-772d-45f9-9b1d-249316383c14 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:15.762700 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ef42a-772d-45f9-9b1d-249316383c14 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:15.762994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ef42a-772d-45f9-9b1d-249316383c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:15.809426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-0d3ef42a-772d-45f9-9b1d-249316383c14 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:15.810651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0d3ef42a-772d-45f9-9b1d-249316383c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:15.876708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1233/2457] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:15.884588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae726cc-1e71-44d0-998b-a6d587c05c1e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:15.884878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae726cc-1e71-44d0-998b-a6d587c05c1e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:15.885778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae726cc-1e71-44d0-998b-a6d587c05c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:15.905408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-cae726cc-1e71-44d0-998b-a6d587c05c1e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:15.906670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cae726cc-1e71-44d0-998b-a6d587c05c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:15.915731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1225/2458] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:15.919777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ef42a-772d-45f9-9b1d-249316383c14 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:15.929570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ef42a-772d-45f9-9b1d-249316383c14 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:15.934522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:15.935156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:15.935432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:15.935702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:15.936369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:37:15.936670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:15.938282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:15.950335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1234/2459] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:37:15.954942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae726cc-1e71-44d0-998b-a6d587c05c1e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:15.964628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae726cc-1e71-44d0-998b-a6d587c05c1e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:15.969895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:15.970523 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:15.970808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:15.971079 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:15.971696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:15.973637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:16.000083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1226/2460] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:15 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:16.004166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:16.014453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784daae6-0b63-4532-8469-e789c79be115 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:16.050898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:16.052796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:16.079290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faece039-7f74-449c-bb4a-27a0eb46d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:16.079891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece039-7f74-449c-bb4a-27a0eb46d8bd admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:16.080166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece039-7f74-449c-bb4a-27a0eb46d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:16.080434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece039-7f74-449c-bb4a-27a0eb46d8bd admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:16.081060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faece039-7f74-449c-bb4a-27a0eb46d8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:16.083630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faece039-7f74-449c-bb4a-27a0eb46d8bd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:16.105706 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1235/2461] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:16 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:16.109493 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faece039-7f74-449c-bb4a-27a0eb46d8bd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:16.113728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c35a2-13c7-4af3-87d1-1b8f8cc47f63 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:16.117408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04f174-fab6-4cf4-84b8-c4d8aa4621b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:16.118005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f174-fab6-4cf4-84b8-c4d8aa4621b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:16.118314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f174-fab6-4cf4-84b8-c4d8aa4621b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:16.118584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f174-fab6-4cf4-84b8-c4d8aa4621b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:16.118865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faece039-7f74-449c-bb4a-27a0eb46d8bd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:16.120288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0d04f174-fab6-4cf4-84b8-c4d8aa4621b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:16.123444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b261-3309-41a5-a4ec-e4ee7d0e11bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:16.124018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b261-3309-41a5-a4ec-e4ee7d0e11bc admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:16.124304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b261-3309-41a5-a4ec-e4ee7d0e11bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:16.124582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b261-3309-41a5-a4ec-e4ee7d0e11bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:16.125216 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1b261-3309-41a5-a4ec-e4ee7d0e11bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:16.126858 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1b261-3309-41a5-a4ec-e4ee7d0e11bc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:16.137253 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1236/2462] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:37:16.143278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b261-3309-41a5-a4ec-e4ee7d0e11bc admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:16.152697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b261-3309-41a5-a4ec-e4ee7d0e11bc admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:16.158054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56192115-6a9d-4c79-b618-f1f6645afd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:16.158664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56192115-6a9d-4c79-b618-f1f6645afd3b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:16.158952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56192115-6a9d-4c79-b618-f1f6645afd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:16.159341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56192115-6a9d-4c79-b618-f1f6645afd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:16.160222 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56192115-6a9d-4c79-b618-f1f6645afd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:16.161854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56192115-6a9d-4c79-b618-f1f6645afd3b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:16.175194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1237/2463] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:16.176213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56192115-6a9d-4c79-b618-f1f6645afd3b admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:16.180252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04f174-fab6-4cf4-84b8-c4d8aa4621b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:16.181700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04f174-fab6-4cf4-84b8-c4d8aa4621b3 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:16.186020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56192115-6a9d-4c79-b618-f1f6645afd3b admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:16.191160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1227/2464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:37:16.191427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:16.192058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:16.192403 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:16.192684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] PATH_INFO: `/v3/projects/1570022f666f419e8142320f86c31551/users/31e602ac8c3747c28e4679f7fbcd4f34/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:16.194974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:16.210787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1570022f666f419e8142320f86c31551, user_id=31e602ac8c3747c28e4679f7fbcd4f34, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:16.213518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:16.226440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1238/2465] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:16 2022] PUT /identity/v3/projects/1570022f666f419e8142320f86c31551/users/31e602ac8c3747c28e4679f7fbcd4f34/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:16.237913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eba4e3-da33-434d-83dc-bb6e5916d078 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:16.238349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eba4e3-da33-434d-83dc-bb6e5916d078 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:16.238634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eba4e3-da33-434d-83dc-bb6e5916d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:16.267705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-06eba4e3-da33-434d-83dc-bb6e5916d078 None None] MFA Rules not processed for user `31e602ac8c3747c28e4679f7fbcd4f34`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:16.269132 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-06eba4e3-da33-434d-83dc-bb6e5916d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:16.323369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:16.334452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1228/2466] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:16.347371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:16.349116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:16.431144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d0b61-86ea-4e5e-ab0e-0f2d8c420aaf admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:16.434896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:16.435499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:16.435782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:16.436060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:16.444989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:16.446451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:16.456206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1239/2467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:20.933048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eba4e3-da33-434d-83dc-bb6e5916d078 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:20.935034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-06eba4e3-da33-434d-83dc-bb6e5916d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:20.999554 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eba4e3-da33-434d-83dc-bb6e5916d078 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:21.003099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:21.003703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:21.003997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:21.004272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:21.005968 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:21.069087 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:21.070742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:21.081317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1229/2468] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:24.193093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:24.195412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:24.290115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9f7c-0bdc-4b55-acd3-8330746e4d60 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:24.295375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9439a19-9e0b-48f2-af86-f3d838864bf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:24.295984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439a19-9e0b-48f2-af86-f3d838864bf1 service placement] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:24.296263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439a19-9e0b-48f2-af86-f3d838864bf1 service placement] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:24.296536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439a19-9e0b-48f2-af86-f3d838864bf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:24.298840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b9439a19-9e0b-48f2-af86-f3d838864bf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:24.310966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9439a19-9e0b-48f2-af86-f3d838864bf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:24.312670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9439a19-9e0b-48f2-af86-f3d838864bf1 service placement] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:24.323220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1240/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:37:24.938835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:24.948406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad0840-24b7-477e-ba7c-82655a96e5dc service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:24.953031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:24.954286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:24.954645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:24.954997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] PATH_INFO: `/v3/users/31e602ac8c3747c28e4679f7fbcd4f34` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:24.956252 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e602ac8c3747c28e4679f7fbcd4f34)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:24.958299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:25.008982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e602ac8c3747c28e4679f7fbcd4f34'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.017155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e602ac8c3747c28e4679f7fbcd4f34'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.017751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e602ac8c3747c28e4679f7fbcd4f34'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.025448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e602ac8c3747c28e4679f7fbcd4f34'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.039115 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e602ac8c3747c28e4679f7fbcd4f34'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.045526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1230/2470] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:24 2022] DELETE /identity/v3/users/31e602ac8c3747c28e4679f7fbcd4f34 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:25.050463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f4c5-3841-467f-86fc-8808f0cf0de9 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:25.050711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f4c5-3841-467f-86fc-8808f0cf0de9 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:25.051081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f4c5-3841-467f-86fc-8808f0cf0de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:25.071205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-84d1f4c5-3841-467f-86fc-8808f0cf0de9 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:25.072314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-84d1f4c5-3841-467f-86fc-8808f0cf0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:25.120453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:25.132638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1241/2471] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:25.145772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:25.147543 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:25.171342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:25.218520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d8ab-e405-40a1-8ee9-55308fb2d8e2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:25.222568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585179cb-6176-4050-a8fa-eb12ca5a675f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:25.223231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585179cb-6176-4050-a8fa-eb12ca5a675f service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:25.223508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585179cb-6176-4050-a8fa-eb12ca5a675f service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:25.223778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585179cb-6176-4050-a8fa-eb12ca5a675f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:25.236234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585179cb-6176-4050-a8fa-eb12ca5a675f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:25.237684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585179cb-6176-4050-a8fa-eb12ca5a675f service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:25.249352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1231/2472] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:37:25.832052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1f4c5-3841-467f-86fc-8808f0cf0de9 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:25.834034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-84d1f4c5-3841-467f-86fc-8808f0cf0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:25.861302 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1f4c5-3841-467f-86fc-8808f0cf0de9 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:25.869500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:25.870952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:25.871854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:25.872521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] PATH_INFO: `/v3/projects/1570022f666f419e8142320f86c31551` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:25.874143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1570022f666f419e8142320f86c31551)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:25.878780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:25.941849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1570022f666f419e8142320f86c31551', 'request_id': 'req-1918efef-288d-4386-b6d6-3efdade65137'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.957539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1570022f666f419e8142320f86c31551', 'request_id': 'req-1918efef-288d-4386-b6d6-3efdade65137'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.964547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1570022f666f419e8142320f86c31551', 'request_id': 'req-1918efef-288d-4386-b6d6-3efdade65137'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.980094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] The token cache is being invalidate because project 1570022f666f419e8142320f86c31551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:25.980865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.981729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-1918efef-288d-4386-b6d6-3efdade65137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:25.983628 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1242/2473] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:25 2022] DELETE /identity/v3/projects/1570022f666f419e8142320f86c31551 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:25.989017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123015bd-8096-4441-8d53-e2b227002588 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:25.989558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123015bd-8096-4441-8d53-e2b227002588 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:25.989558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123015bd-8096-4441-8d53-e2b227002588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.012138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-123015bd-8096-4441-8d53-e2b227002588 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:26.013393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-123015bd-8096-4441-8d53-e2b227002588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:26.084722 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1232/2474] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:26.093124 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32752d-f14c-4420-bca6-d061c11f0bc1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.093523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32752d-f14c-4420-bca6-d061c11f0bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.094481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32752d-f14c-4420-bca6-d061c11f0bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.117192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8c32752d-f14c-4420-bca6-d061c11f0bc1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:26.118631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8c32752d-f14c-4420-bca6-d061c11f0bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:26.127593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1243/2475] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:26.131629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123015bd-8096-4441-8d53-e2b227002588 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.141489 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123015bd-8096-4441-8d53-e2b227002588 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.147502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.148110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.148395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.148668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.149318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:37:26.149620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.151496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.166236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1233/2476] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:37:26.169438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32752d-f14c-4420-bca6-d061c11f0bc1 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.181466 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32752d-f14c-4420-bca6-d061c11f0bc1 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.186586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216ca5-1eba-4ac5-ae4c-278ca0f916d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.187321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216ca5-1eba-4ac5-ae4c-278ca0f916d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.187745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216ca5-1eba-4ac5-ae4c-278ca0f916d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.188339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216ca5-1eba-4ac5-ae4c-278ca0f916d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.188843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f216ca5-1eba-4ac5-ae4c-278ca0f916d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.190873 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f216ca5-1eba-4ac5-ae4c-278ca0f916d7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.226915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1244/2477] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:26 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:26.228687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.240224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2765-3c00-40f4-9841-cccb6450056c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.304190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08032e-588b-4cff-8016-06432274d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.304912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08032e-588b-4cff-8016-06432274d303 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.305194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08032e-588b-4cff-8016-06432274d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.305470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08032e-588b-4cff-8016-06432274d303 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.306102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08032e-588b-4cff-8016-06432274d303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.308138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08032e-588b-4cff-8016-06432274d303 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.335614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1234/2478] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:26 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:26.340270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216ca5-1eba-4ac5-ae4c-278ca0f916d7 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.351987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216ca5-1eba-4ac5-ae4c-278ca0f916d7 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.357005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace253-b8f2-4025-8d47-a4fad67ad6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.357621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace253-b8f2-4025-8d47-a4fad67ad6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.357895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace253-b8f2-4025-8d47-a4fad67ad6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.358211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace253-b8f2-4025-8d47-a4fad67ad6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.358853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bace253-b8f2-4025-8d47-a4fad67ad6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.360701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bace253-b8f2-4025-8d47-a4fad67ad6a0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.377903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08032e-588b-4cff-8016-06432274d303 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.378356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1245/2479] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:26.388005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08032e-588b-4cff-8016-06432274d303 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.394110 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d26f2b-b6ab-4f2d-9023-2c0aac0f1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.394816 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f2b-b6ab-4f2d-9023-2c0aac0f1880 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.395190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f2b-b6ab-4f2d-9023-2c0aac0f1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.395473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f2b-b6ab-4f2d-9023-2c0aac0f1880 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.396305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d26f2b-b6ab-4f2d-9023-2c0aac0f1880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.397956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d26f2b-b6ab-4f2d-9023-2c0aac0f1880 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.414140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace253-b8f2-4025-8d47-a4fad67ad6a0 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.414511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1235/2480] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:26.424519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace253-b8f2-4025-8d47-a4fad67ad6a0 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.430332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74b69e-087e-4d0d-bad4-83e52ffa3bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.431138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b69e-087e-4d0d-bad4-83e52ffa3bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.431447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b69e-087e-4d0d-bad4-83e52ffa3bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.431855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b69e-087e-4d0d-bad4-83e52ffa3bcd admin admin] PATH_INFO: `/v3/projects/0d22c458a8ed45788f9936b2ef8bb89e/users/405d31839c3841dc8d41734ca0fff7e0/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.452663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74b69e-087e-4d0d-bad4-83e52ffa3bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d22c458a8ed45788f9936b2ef8bb89e, user_id=405d31839c3841dc8d41734ca0fff7e0, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.456613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74b69e-087e-4d0d-bad4-83e52ffa3bcd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.475314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1246/2481] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:26 2022] PUT /identity/v3/projects/0d22c458a8ed45788f9936b2ef8bb89e/users/405d31839c3841dc8d41734ca0fff7e0/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:26.485539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e648bd4-2c0d-4a7d-9d37-14948f2197c4 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.485916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e648bd4-2c0d-4a7d-9d37-14948f2197c4 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.486290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e648bd4-2c0d-4a7d-9d37-14948f2197c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.517358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8e648bd4-2c0d-4a7d-9d37-14948f2197c4 None None] MFA Rules not processed for user `405d31839c3841dc8d41734ca0fff7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:26.518884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8e648bd4-2c0d-4a7d-9d37-14948f2197c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:26.533673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:26.595709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1236/2482] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:26.600151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74b69e-087e-4d0d-bad4-83e52ffa3bcd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.669127 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74b69e-087e-4d0d-bad4-83e52ffa3bcd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.673839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe36b-9ddc-4f7e-b5cd-10e5b32ebbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.674502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe36b-9ddc-4f7e-b5cd-10e5b32ebbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.674812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe36b-9ddc-4f7e-b5cd-10e5b32ebbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.675063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe36b-9ddc-4f7e-b5cd-10e5b32ebbb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.675698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fe36b-9ddc-4f7e-b5cd-10e5b32ebbb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.677588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fe36b-9ddc-4f7e-b5cd-10e5b32ebbb3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.700115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:26.711569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1247/2483] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:26 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:26.712731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e648bd4-2c0d-4a7d-9d37-14948f2197c4 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.723457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e648bd4-2c0d-4a7d-9d37-14948f2197c4 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.782449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e9ce-9f21-4709-b5b7-52dadf4221e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.783059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e9ce-9f21-4709-b5b7-52dadf4221e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.783338 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e9ce-9f21-4709-b5b7-52dadf4221e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.783612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e9ce-9f21-4709-b5b7-52dadf4221e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.784241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598e9ce-9f21-4709-b5b7-52dadf4221e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.786191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598e9ce-9f21-4709-b5b7-52dadf4221e0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.810527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1237/2484] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:26 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:26.812022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe36b-9ddc-4f7e-b5cd-10e5b32ebbb3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.824701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe36b-9ddc-4f7e-b5cd-10e5b32ebbb3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.829972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68df6e-7448-4fd5-bf73-efac8af43f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.830593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68df6e-7448-4fd5-bf73-efac8af43f3d admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.830896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68df6e-7448-4fd5-bf73-efac8af43f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.831165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68df6e-7448-4fd5-bf73-efac8af43f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.831798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68df6e-7448-4fd5-bf73-efac8af43f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.833412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68df6e-7448-4fd5-bf73-efac8af43f3d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.844398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1248/2485] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:26.848639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e9ce-9f21-4709-b5b7-52dadf4221e0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.861839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e9ce-9f21-4709-b5b7-52dadf4221e0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:26.866642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34ba1-f921-425e-8b4c-64d14598317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:26.867980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34ba1-f921-425e-8b4c-64d14598317b admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:26.868313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34ba1-f921-425e-8b4c-64d14598317b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:26.868617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34ba1-f921-425e-8b4c-64d14598317b admin admin] PATH_INFO: `/v3/projects/4c5df706e78144419b2986e246915252/users/e4f25d6357b54cd7a93a25537530f930/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:26.888014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34ba1-f921-425e-8b4c-64d14598317b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5df706e78144419b2986e246915252, user_id=e4f25d6357b54cd7a93a25537530f930, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:26.891377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34ba1-f921-425e-8b4c-64d14598317b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:26.915933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1238/2486] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:26 2022] PUT /identity/v3/projects/4c5df706e78144419b2986e246915252/users/e4f25d6357b54cd7a93a25537530f930/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:26.925337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68df6e-7448-4fd5-bf73-efac8af43f3d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:26.936010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68df6e-7448-4fd5-bf73-efac8af43f3d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:27.020081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62708a9f-97e0-4648-92a7-7463e8472d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:27.020813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708a9f-97e0-4648-92a7-7463e8472d69 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:27.021165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708a9f-97e0-4648-92a7-7463e8472d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:27.021513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708a9f-97e0-4648-92a7-7463e8472d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:27.022267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62708a9f-97e0-4648-92a7-7463e8472d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:27.024453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62708a9f-97e0-4648-92a7-7463e8472d69 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:27.041691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1249/2487] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:27.042668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34ba1-f921-425e-8b4c-64d14598317b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:27.056698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34ba1-f921-425e-8b4c-64d14598317b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:27.069315 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:27.070101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:27.070372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:27.070646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] PATH_INFO: `/v3/projects/4c5df706e78144419b2986e246915252/users/e4f25d6357b54cd7a93a25537530f930/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:27.075004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5df706e78144419b2986e246915252, user_id=e4f25d6357b54cd7a93a25537530f930, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:27.080607 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:27.094054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1239/2488] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:27 2022] PUT /identity/v3/projects/4c5df706e78144419b2986e246915252/users/e4f25d6357b54cd7a93a25537530f930/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:27.105432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176b5e-a48c-47cb-8f26-3c3d82335b8b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:27.105721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176b5e-a48c-47cb-8f26-3c3d82335b8b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:27.106001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176b5e-a48c-47cb-8f26-3c3d82335b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:27.134716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-c4176b5e-a48c-47cb-8f26-3c3d82335b8b None None] MFA Rules not processed for user `e4f25d6357b54cd7a93a25537530f930`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:27.135961 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c4176b5e-a48c-47cb-8f26-3c3d82335b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:27.204048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1250/2489] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:27.215380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:27.217060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:27.283743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719885f-2b9a-49a2-81f5-987483058343 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:27.287399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:27.288000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:27.288275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:27.289033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:27.299147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:27.300598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:27.310633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1240/2490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:27.393608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4176b5e-a48c-47cb-8f26-3c3d82335b8b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:27.420239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4176b5e-a48c-47cb-8f26-3c3d82335b8b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:27.425435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81718a-73ee-48ca-89a0-2227a74727b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:27.426113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81718a-73ee-48ca-89a0-2227a74727b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:27.426390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81718a-73ee-48ca-89a0-2227a74727b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:27.426682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81718a-73ee-48ca-89a0-2227a74727b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:27.500207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81718a-73ee-48ca-89a0-2227a74727b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:27.501785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81718a-73ee-48ca-89a0-2227a74727b5 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:27.509467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:27.512357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:27.515817 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1251/2491] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:27.530882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:27.591003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf05ed-6079-4117-8274-046c6672fa78 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:27.597089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:27.597804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:27.598135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:27.598388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] PATH_INFO: `/v3/users/aa1b7491f8c14298a959ff9c96394a99` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:27.599682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1b7491f8c14298a959ff9c96394a99)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:27.601961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:27.675699 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1b7491f8c14298a959ff9c96394a99'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:27.685196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1b7491f8c14298a959ff9c96394a99'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:27.686002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1b7491f8c14298a959ff9c96394a99'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:27.696790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1b7491f8c14298a959ff9c96394a99'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:27.710221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1b7491f8c14298a959ff9c96394a99'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:27.717759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1241/2492] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:27 2022] DELETE /identity/v3/users/aa1b7491f8c14298a959ff9c96394a99 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:27.910847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81718a-73ee-48ca-89a0-2227a74727b5 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:27.923563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81718a-73ee-48ca-89a0-2227a74727b5 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:27.928993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:27.987417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:27.988045 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:27.988368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:27.988595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] PATH_INFO: `/v3/projects/9199eab313d04526840a59f1de2cdeb3` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:27.989697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9199eab313d04526840a59f1de2cdeb3)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:27.991634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:28.038151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9199eab313d04526840a59f1de2cdeb3', 'request_id': 'req-47fb5a92-f724-4a40-8720-7246143fbd46'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.043625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9199eab313d04526840a59f1de2cdeb3', 'request_id': 'req-47fb5a92-f724-4a40-8720-7246143fbd46'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.049891 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9199eab313d04526840a59f1de2cdeb3', 'request_id': 'req-47fb5a92-f724-4a40-8720-7246143fbd46'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.062155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] The token cache is being invalidate because project 9199eab313d04526840a59f1de2cdeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:28.062392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.063009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.064482 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1252/2493] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:27 2022] DELETE /identity/v3/projects/9199eab313d04526840a59f1de2cdeb3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:28.068481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:28.069888 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:28.083394 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8a259-56f2-4d8d-b562-c582ad4a96b1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:28.143806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:28.144431 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:28.144714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:28.144990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] PATH_INFO: `/v3/users/1251640af89c43b7a157614bea746165` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:28.146144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1251640af89c43b7a157614bea746165)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:28.148075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:28.180791 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:28.194454 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1251640af89c43b7a157614bea746165'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.202268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1251640af89c43b7a157614bea746165'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.202889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1251640af89c43b7a157614bea746165'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.210354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1251640af89c43b7a157614bea746165'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.222008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1251640af89c43b7a157614bea746165'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.227800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1242/2494] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:28 2022] DELETE /identity/v3/users/1251640af89c43b7a157614bea746165 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:28.398225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:28.399721 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:28.412731 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb5a92-f724-4a40-8720-7246143fbd46 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:28.471725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:28.472350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:28.472632 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:28.472910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] PATH_INFO: `/v3/projects/7aac2bc94668403496274bf781fc3aab` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:28.474020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aac2bc94668403496274bf781fc3aab)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:28.475935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:28.516273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:28.523347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aac2bc94668403496274bf781fc3aab', 'request_id': 'req-8c5484f3-3afd-4313-8d92-62e264e5d3b8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.529531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aac2bc94668403496274bf781fc3aab', 'request_id': 'req-8c5484f3-3afd-4313-8d92-62e264e5d3b8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.535845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aac2bc94668403496274bf781fc3aab', 'request_id': 'req-8c5484f3-3afd-4313-8d92-62e264e5d3b8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.547940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] The token cache is being invalidate because project 7aac2bc94668403496274bf781fc3aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:28.548231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.548840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:28.550336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1253/2495] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:28 2022] DELETE /identity/v3/projects/7aac2bc94668403496274bf781fc3aab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:38.224333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=17,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:38.547194 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:49.008383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:49.009898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:49.067841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae480bb2-4507-4055-91b7-dbe1b15a2dc6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:49.114749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:49.115281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:49.115562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:49.115836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:49.117562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:49.179966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:49.181405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:49.190892 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1243/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:37:52.119262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:52.121077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:52.137527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5484f3-3afd-4313-8d92-62e264e5d3b8 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:52.143479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:52.144292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.144641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.145189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] PATH_INFO: `/v3/users/17cc8db0bbd24c4098931f2c53381751` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.146386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cc8db0bbd24c4098931f2c53381751)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:52.148457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:52.200284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cc8db0bbd24c4098931f2c53381751'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.208528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cc8db0bbd24c4098931f2c53381751'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.209248 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cc8db0bbd24c4098931f2c53381751'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.209882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cc8db0bbd24c4098931f2c53381751'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.221759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c46c3090-0b80-44a1-920b-ea59af32a03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cc8db0bbd24c4098931f2c53381751'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.233884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1254/2497] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:52 2022] DELETE /identity/v3/users/17cc8db0bbd24c4098931f2c53381751 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:52.406762 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:52.419436 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63897d-5423-4c47-bb57-c2eded2a1453 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:52.476604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:52.477237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.477521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.477804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] PATH_INFO: `/v3/projects/0a396293b81d43a4ada96b3d49e7dae7` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.478960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a396293b81d43a4ada96b3d49e7dae7)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:52.480870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:52.489618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:52.532288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a396293b81d43a4ada96b3d49e7dae7', 'request_id': 'req-5c52d498-f3e7-4bd0-88ad-365504577994'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.538435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a396293b81d43a4ada96b3d49e7dae7', 'request_id': 'req-5c52d498-f3e7-4bd0-88ad-365504577994'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.544615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a396293b81d43a4ada96b3d49e7dae7', 'request_id': 'req-5c52d498-f3e7-4bd0-88ad-365504577994'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.557820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] The token cache is being invalidate because project 0a396293b81d43a4ada96b3d49e7dae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:52.558126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.558767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c52d498-f3e7-4bd0-88ad-365504577994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:52.560421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1244/2498] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:52 2022] DELETE /identity/v3/projects/0a396293b81d43a4ada96b3d49e7dae7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:52.565440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37203c-b02b-4345-b1ed-8acde0da5976 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.565907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37203c-b02b-4345-b1ed-8acde0da5976 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.566221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37203c-b02b-4345-b1ed-8acde0da5976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.587051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ed37203c-b02b-4345-b1ed-8acde0da5976 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:52.588250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ed37203c-b02b-4345-b1ed-8acde0da5976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:52.652200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1255/2499] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:52.662044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc3f99-482e-4b45-9086-865c3deacab9 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.662395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc3f99-482e-4b45-9086-865c3deacab9 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.662668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc3f99-482e-4b45-9086-865c3deacab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.683125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-12dc3f99-482e-4b45-9086-865c3deacab9 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:52.684577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-12dc3f99-482e-4b45-9086-865c3deacab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:52.692666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1245/2500] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:52.697198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37203c-b02b-4345-b1ed-8acde0da5976 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:52.708562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37203c-b02b-4345-b1ed-8acde0da5976 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:52.713174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:52.713773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.714054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.714418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.715021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:37:52.715320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:52.716908 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:52.729441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1256/2501] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:37:52.733907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc3f99-482e-4b45-9086-865c3deacab9 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:52.743230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc3f99-482e-4b45-9086-865c3deacab9 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:52.747823 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53a8b6-abd5-4729-bcaf-6563421fd65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:52.748403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a8b6-abd5-4729-bcaf-6563421fd65f admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.748676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a8b6-abd5-4729-bcaf-6563421fd65f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.748947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a8b6-abd5-4729-bcaf-6563421fd65f admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.749589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53a8b6-abd5-4729-bcaf-6563421fd65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:52.751555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53a8b6-abd5-4729-bcaf-6563421fd65f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:52.780027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1246/2502] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:52 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:52.784705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:52.794573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32e72a-787c-4def-9c3c-25ca0b658181 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:52.848877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86a520-53f5-4c13-bcc1-d61f804c4f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:52.849487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a520-53f5-4c13-bcc1-d61f804c4f6c admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.849770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a520-53f5-4c13-bcc1-d61f804c4f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.850044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a520-53f5-4c13-bcc1-d61f804c4f6c admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.850705 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86a520-53f5-4c13-bcc1-d61f804c4f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:52.852612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86a520-53f5-4c13-bcc1-d61f804c4f6c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:52.863800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:52.878909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1257/2503] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:52 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:52.883037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53a8b6-abd5-4729-bcaf-6563421fd65f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:52.893938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53a8b6-abd5-4729-bcaf-6563421fd65f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:52.898551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a206db-76e0-4647-83a9-c7bb8caacd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:52.899130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a206db-76e0-4647-83a9-c7bb8caacd44 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.899407 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a206db-76e0-4647-83a9-c7bb8caacd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.899676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a206db-76e0-4647-83a9-c7bb8caacd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.900383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a206db-76e0-4647-83a9-c7bb8caacd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:52.901963 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a206db-76e0-4647-83a9-c7bb8caacd44 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:52.912381 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1247/2504] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:52.916010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86a520-53f5-4c13-bcc1-d61f804c4f6c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:52.925711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86a520-53f5-4c13-bcc1-d61f804c4f6c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:52.935350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb05304-4c0d-45d0-92bb-0c10905eaf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:52.935947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05304-4c0d-45d0-92bb-0c10905eaf33 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.936223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05304-4c0d-45d0-92bb-0c10905eaf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.936517 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05304-4c0d-45d0-92bb-0c10905eaf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.937174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb05304-4c0d-45d0-92bb-0c10905eaf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:52.939319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb05304-4c0d-45d0-92bb-0c10905eaf33 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:52.949974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1258/2505] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:52.954267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a206db-76e0-4647-83a9-c7bb8caacd44 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:52.964137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a206db-76e0-4647-83a9-c7bb8caacd44 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:52.968681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40043e-50d8-4bf9-a41f-a92190400528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:52.969341 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40043e-50d8-4bf9-a41f-a92190400528 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:52.970133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40043e-50d8-4bf9-a41f-a92190400528 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:52.970410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40043e-50d8-4bf9-a41f-a92190400528 admin admin] PATH_INFO: `/v3/projects/4a0167b9973344638b7f3211ff749692/users/af7408f32ca347ddb24521ac44772202/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:52.984518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40043e-50d8-4bf9-a41f-a92190400528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0167b9973344638b7f3211ff749692, user_id=af7408f32ca347ddb24521ac44772202, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:52.987767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40043e-50d8-4bf9-a41f-a92190400528 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:53.000233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1248/2506] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:52 2022] PUT /identity/v3/projects/4a0167b9973344638b7f3211ff749692/users/af7408f32ca347ddb24521ac44772202/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:53.010309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91e0c-fb55-46ca-8047-a8ee377105b5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.010598 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91e0c-fb55-46ca-8047-a8ee377105b5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.010899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91e0c-fb55-46ca-8047-a8ee377105b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.038029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-26e91e0c-fb55-46ca-8047-a8ee377105b5 None None] MFA Rules not processed for user `af7408f32ca347ddb24521ac44772202`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:53.039249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-26e91e0c-fb55-46ca-8047-a8ee377105b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:53.105608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1259/2507] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:53.110376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40043e-50d8-4bf9-a41f-a92190400528 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:53.171491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40043e-50d8-4bf9-a41f-a92190400528 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:53.176804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ea563-95bb-4e96-bea2-a7b60badaf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:53.177396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ea563-95bb-4e96-bea2-a7b60badaf8c admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.177678 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ea563-95bb-4e96-bea2-a7b60badaf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.177957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ea563-95bb-4e96-bea2-a7b60badaf8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.178605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ea563-95bb-4e96-bea2-a7b60badaf8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:53.180498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ea563-95bb-4e96-bea2-a7b60badaf8c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:53.205234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1249/2508] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:53 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:53.209352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91e0c-fb55-46ca-8047-a8ee377105b5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:53.220441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91e0c-fb55-46ca-8047-a8ee377105b5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:53.275213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839f349-5119-4271-94f3-ae9c6e6cc3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:53.275800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839f349-5119-4271-94f3-ae9c6e6cc3fc admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.276090 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839f349-5119-4271-94f3-ae9c6e6cc3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.276382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839f349-5119-4271-94f3-ae9c6e6cc3fc admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.276978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839f349-5119-4271-94f3-ae9c6e6cc3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:53.278905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839f349-5119-4271-94f3-ae9c6e6cc3fc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:53.299616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1260/2509] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:53 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:53.303567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ea563-95bb-4e96-bea2-a7b60badaf8c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:53.314282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ea563-95bb-4e96-bea2-a7b60badaf8c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:53.318901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2904f5-240e-46b8-86e0-3ea2de44e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:53.319486 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2904f5-240e-46b8-86e0-3ea2de44e88d admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.319767 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2904f5-240e-46b8-86e0-3ea2de44e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.320039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2904f5-240e-46b8-86e0-3ea2de44e88d admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.320676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2904f5-240e-46b8-86e0-3ea2de44e88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:53.322301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2904f5-240e-46b8-86e0-3ea2de44e88d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:53.332541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1250/2510] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:53.336479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839f349-5119-4271-94f3-ae9c6e6cc3fc admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:53.346365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839f349-5119-4271-94f3-ae9c6e6cc3fc admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:53.350937 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7856a08-aefc-4842-8d4b-f32b4f9724fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:53.351577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856a08-aefc-4842-8d4b-f32b4f9724fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.351859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856a08-aefc-4842-8d4b-f32b4f9724fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.352136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856a08-aefc-4842-8d4b-f32b4f9724fc admin admin] PATH_INFO: `/v3/projects/187c2de3acc74021826dd3ec04d07d24/users/4fa620289d8149f09ed6153599ab3c15/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.369290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7856a08-aefc-4842-8d4b-f32b4f9724fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=187c2de3acc74021826dd3ec04d07d24, user_id=4fa620289d8149f09ed6153599ab3c15, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:53.372727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7856a08-aefc-4842-8d4b-f32b4f9724fc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:53.385938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1261/2511] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:53 2022] PUT /identity/v3/projects/187c2de3acc74021826dd3ec04d07d24/users/4fa620289d8149f09ed6153599ab3c15/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:53.389957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2904f5-240e-46b8-86e0-3ea2de44e88d admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:53.400047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2904f5-240e-46b8-86e0-3ea2de44e88d admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:53.403579 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:53.456426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4dc55-a3a7-490a-9f52-9a4cc0dc9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:53.457096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4dc55-a3a7-490a-9f52-9a4cc0dc9595 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.457290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4dc55-a3a7-490a-9f52-9a4cc0dc9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.457560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4dc55-a3a7-490a-9f52-9a4cc0dc9595 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.458220 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4dc55-a3a7-490a-9f52-9a4cc0dc9595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:53.459804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4dc55-a3a7-490a-9f52-9a4cc0dc9595 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:53.469163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1251/2512] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:53.473292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7856a08-aefc-4842-8d4b-f32b4f9724fc admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:53.483416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7856a08-aefc-4842-8d4b-f32b4f9724fc admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:53.488688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:53.489343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.489652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.489929 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] PATH_INFO: `/v3/projects/187c2de3acc74021826dd3ec04d07d24/users/4fa620289d8149f09ed6153599ab3c15/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.491896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187c2de3acc74021826dd3ec04d07d24, user_id=4fa620289d8149f09ed6153599ab3c15, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:53.494584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:53.505227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1262/2513] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:53 2022] PUT /identity/v3/projects/187c2de3acc74021826dd3ec04d07d24/users/4fa620289d8149f09ed6153599ab3c15/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:53.515118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904892b-fd76-4e6a-844e-aefd275e7389 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.515434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904892b-fd76-4e6a-844e-aefd275e7389 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.515685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904892b-fd76-4e6a-844e-aefd275e7389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.542479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7904892b-fd76-4e6a-844e-aefd275e7389 None None] MFA Rules not processed for user `4fa620289d8149f09ed6153599ab3c15`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:53.543609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7904892b-fd76-4e6a-844e-aefd275e7389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:53.609733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1252/2514] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:53.621635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:53.623359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:53.646653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:53.682046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020470a-956c-4dac-a151-ee4c12353a08 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:53.685636 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab472a5-b397-4533-ae1e-19a1334388f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:53.686259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab472a5-b397-4533-ae1e-19a1334388f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:53.686539 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab472a5-b397-4533-ae1e-19a1334388f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:53.686814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab472a5-b397-4533-ae1e-19a1334388f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:53.696246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab472a5-b397-4533-ae1e-19a1334388f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:53.697660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab472a5-b397-4533-ae1e-19a1334388f6 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:53.707414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1263/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:54.114550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904892b-fd76-4e6a-844e-aefd275e7389 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:54.174602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904892b-fd76-4e6a-844e-aefd275e7389 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:54.179032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:54.179641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:54.179917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:54.180188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] PATH_INFO: `/v3/users/af7408f32ca347ddb24521ac44772202` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:54.181279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7408f32ca347ddb24521ac44772202)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:54.183224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:54.215296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:54.229086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7408f32ca347ddb24521ac44772202'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.236657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7408f32ca347ddb24521ac44772202'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.237365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7408f32ca347ddb24521ac44772202'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.244406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7408f32ca347ddb24521ac44772202'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.256665 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7408f32ca347ddb24521ac44772202'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.262351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1253/2516] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:54 2022] DELETE /identity/v3/users/af7408f32ca347ddb24521ac44772202 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:54.266959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8d6d-1229-4e71-bd92-f303ccd562fe None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:54.267445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8d6d-1229-4e71-bd92-f303ccd562fe None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:54.267552 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8d6d-1229-4e71-bd92-f303ccd562fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:54.287624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-cc2d8d6d-1229-4e71-bd92-f303ccd562fe None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:54.288807 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cc2d8d6d-1229-4e71-bd92-f303ccd562fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:54.345094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1264/2517] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:54.354871 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:54.356297 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:54.413954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f549d2-3008-4957-9cf8-51d4abbc4a50 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:54.417749 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379fe97-e2d2-4d0a-89da-b15230c4cd07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:54.418435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379fe97-e2d2-4d0a-89da-b15230c4cd07 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:54.418714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379fe97-e2d2-4d0a-89da-b15230c4cd07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:54.418984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379fe97-e2d2-4d0a-89da-b15230c4cd07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:54.427707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379fe97-e2d2-4d0a-89da-b15230c4cd07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:54.429127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379fe97-e2d2-4d0a-89da-b15230c4cd07 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:54.439056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1254/2518] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:54.711540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8d6d-1229-4e71-bd92-f303ccd562fe None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:54.712993 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cc2d8d6d-1229-4e71-bd92-f303ccd562fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:54.730399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8d6d-1229-4e71-bd92-f303ccd562fe None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:54.735105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:54.736240 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:54.736518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:54.736783 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] PATH_INFO: `/v3/projects/4a0167b9973344638b7f3211ff749692` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:54.737894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0167b9973344638b7f3211ff749692)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:54.739810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:54.786713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0167b9973344638b7f3211ff749692', 'request_id': 'req-9b125853-ac47-4fda-b86f-21ec9a9e587e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.792062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0167b9973344638b7f3211ff749692', 'request_id': 'req-9b125853-ac47-4fda-b86f-21ec9a9e587e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.798600 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0167b9973344638b7f3211ff749692', 'request_id': 'req-9b125853-ac47-4fda-b86f-21ec9a9e587e'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.812103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] The token cache is being invalidate because project 4a0167b9973344638b7f3211ff749692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:54.812419 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.813735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.814995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1265/2519] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:54 2022] DELETE /identity/v3/projects/4a0167b9973344638b7f3211ff749692 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:54.819072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379fe97-e2d2-4d0a-89da-b15230c4cd07 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:54.830002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379fe97-e2d2-4d0a-89da-b15230c4cd07 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:54.886082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:54.886714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:54.886988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:54.887258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] PATH_INFO: `/v3/users/4fa620289d8149f09ed6153599ab3c15` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:54.888386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa620289d8149f09ed6153599ab3c15)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:54.890318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:54.939652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa620289d8149f09ed6153599ab3c15'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.943203 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:54.947720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa620289d8149f09ed6153599ab3c15'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.948416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa620289d8149f09ed6153599ab3c15'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.957305 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa620289d8149f09ed6153599ab3c15'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.970520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-64e2f0a1-c2ce-46a4-b7ca-42f2d4e004cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa620289d8149f09ed6153599ab3c15'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:54.980571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1255/2520] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:54 2022] DELETE /identity/v3/users/4fa620289d8149f09ed6153599ab3c15 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:55.248155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:55.249892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:55.264710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b125853-ac47-4fda-b86f-21ec9a9e587e admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:55.314414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:55.331536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:55.332165 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.332443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.332713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] PATH_INFO: `/v3/projects/187c2de3acc74021826dd3ec04d07d24` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.333819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187c2de3acc74021826dd3ec04d07d24)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:55.335728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:55.383303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187c2de3acc74021826dd3ec04d07d24', 'request_id': 'req-0e79e25a-d60c-4a99-934f-d0be391b02e1'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:55.390034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187c2de3acc74021826dd3ec04d07d24', 'request_id': 'req-0e79e25a-d60c-4a99-934f-d0be391b02e1'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:55.397674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187c2de3acc74021826dd3ec04d07d24', 'request_id': 'req-0e79e25a-d60c-4a99-934f-d0be391b02e1'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:55.412053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] The token cache is being invalidate because project 187c2de3acc74021826dd3ec04d07d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:55.412350 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:55.413021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e79e25a-d60c-4a99-934f-d0be391b02e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:55.414559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1266/2521] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:55 2022] DELETE /identity/v3/projects/187c2de3acc74021826dd3ec04d07d24 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:55.419491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617f522-5b77-46f7-b33b-154bb00a47c5 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.419782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617f522-5b77-46f7-b33b-154bb00a47c5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.420059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617f522-5b77-46f7-b33b-154bb00a47c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.441100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e617f522-5b77-46f7-b33b-154bb00a47c5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:55.442356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e617f522-5b77-46f7-b33b-154bb00a47c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:55.501818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1256/2522] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:55.511443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655711b-2730-4782-a697-fb850fa426a3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.511848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655711b-2730-4782-a697-fb850fa426a3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.512139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655711b-2730-4782-a697-fb850fa426a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.533163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6655711b-2730-4782-a697-fb850fa426a3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:55.534469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6655711b-2730-4782-a697-fb850fa426a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:55.542815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1267/2523] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:55.547088 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617f522-5b77-46f7-b33b-154bb00a47c5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:55.557146 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617f522-5b77-46f7-b33b-154bb00a47c5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:55.562050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:55.562864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.563128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.564133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.564798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:37:55.565112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:55.567102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:55.580003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1257/2524] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:37:55.584652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655711b-2730-4782-a697-fb850fa426a3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:55.595576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655711b-2730-4782-a697-fb850fa426a3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:55.601549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06685-d156-4550-ad6b-3051011d32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:55.602192 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06685-d156-4550-ad6b-3051011d32f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.602477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06685-d156-4550-ad6b-3051011d32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.602750 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06685-d156-4550-ad6b-3051011d32f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.603384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d06685-d156-4550-ad6b-3051011d32f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:55.605268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d06685-d156-4550-ad6b-3051011d32f2 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:55.635028 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1268/2525] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:55 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:55.639240 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:55.650360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28330faa-7cad-4279-a967-8cc4f6c1b325 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:55.707301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a5e3-f23a-4820-84dd-321785da220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:55.707896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a5e3-f23a-4820-84dd-321785da220f admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.708179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a5e3-f23a-4820-84dd-321785da220f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.708449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a5e3-f23a-4820-84dd-321785da220f admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.709059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a5e3-f23a-4820-84dd-321785da220f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:55.711023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a5e3-f23a-4820-84dd-321785da220f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:55.735893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1258/2526] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:55 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:55.739990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06685-d156-4550-ad6b-3051011d32f2 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:55.750476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06685-d156-4550-ad6b-3051011d32f2 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:55.755099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c729d-0de2-4070-a8e7-6c2f667e1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:55.755694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c729d-0de2-4070-a8e7-6c2f667e1ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.755976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c729d-0de2-4070-a8e7-6c2f667e1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.756252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c729d-0de2-4070-a8e7-6c2f667e1ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.756892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c729d-0de2-4070-a8e7-6c2f667e1ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:55.758510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c729d-0de2-4070-a8e7-6c2f667e1ee6 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:55.769135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1269/2527] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:55.772960 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a5e3-f23a-4820-84dd-321785da220f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:55.783460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a5e3-f23a-4820-84dd-321785da220f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:55.788364 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71703921-4714-468d-a51a-1af732a4ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:55.788951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703921-4714-468d-a51a-1af732a4ecd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.789236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703921-4714-468d-a51a-1af732a4ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.789512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71703921-4714-468d-a51a-1af732a4ecd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.790200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71703921-4714-468d-a51a-1af732a4ecd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:55.791771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71703921-4714-468d-a51a-1af732a4ecd8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:55.802958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1259/2528] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:55.806915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c729d-0de2-4070-a8e7-6c2f667e1ee6 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:55.816803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c729d-0de2-4070-a8e7-6c2f667e1ee6 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:55.821429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa6056-4e58-40fb-b7af-ed453cc2adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:55.822087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa6056-4e58-40fb-b7af-ed453cc2adb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.822387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa6056-4e58-40fb-b7af-ed453cc2adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.822663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa6056-4e58-40fb-b7af-ed453cc2adb4 admin admin] PATH_INFO: `/v3/projects/1d44ce721f924d549ee377affec1925b/users/5fe7231ab6f84dbeb34b6c7eba896832/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.837234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa6056-4e58-40fb-b7af-ed453cc2adb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d44ce721f924d549ee377affec1925b, user_id=5fe7231ab6f84dbeb34b6c7eba896832, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:55.839905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa6056-4e58-40fb-b7af-ed453cc2adb4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:55.853183 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1270/2529] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:55 2022] PUT /identity/v3/projects/1d44ce721f924d549ee377affec1925b/users/5fe7231ab6f84dbeb34b6c7eba896832/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:55.864063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703573-7e3c-40c0-b791-c347dce49eba None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:55.864499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703573-7e3c-40c0-b791-c347dce49eba None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:55.864625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703573-7e3c-40c0-b791-c347dce49eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:55.893069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-97703573-7e3c-40c0-b791-c347dce49eba None None] MFA Rules not processed for user `5fe7231ab6f84dbeb34b6c7eba896832`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:55.894249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-97703573-7e3c-40c0-b791-c347dce49eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:55.917716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:55.958879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1260/2530] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:55.963279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa6056-4e58-40fb-b7af-ed453cc2adb4 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:56.025579 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa6056-4e58-40fb-b7af-ed453cc2adb4 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:56.030162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f23a7-f92f-444c-94da-56815accbb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:56.030756 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f23a7-f92f-444c-94da-56815accbb52 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.031034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f23a7-f92f-444c-94da-56815accbb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.031304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f23a7-f92f-444c-94da-56815accbb52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.031928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f23a7-f92f-444c-94da-56815accbb52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:56.034320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f23a7-f92f-444c-94da-56815accbb52 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:56.053868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:56.061234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1271/2531] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:55 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:56.065077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703573-7e3c-40c0-b791-c347dce49eba None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:56.075624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703573-7e3c-40c0-b791-c347dce49eba None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:56.130092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee934-0a39-47b7-b620-4ad982e5e2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:56.130685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee934-0a39-47b7-b620-4ad982e5e2fa admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.130965 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee934-0a39-47b7-b620-4ad982e5e2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.131238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee934-0a39-47b7-b620-4ad982e5e2fa admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.131847 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee934-0a39-47b7-b620-4ad982e5e2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:56.133756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee934-0a39-47b7-b620-4ad982e5e2fa admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:56.154929 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1261/2532] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:56 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:56.159500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f23a7-f92f-444c-94da-56815accbb52 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:56.169680 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f23a7-f92f-444c-94da-56815accbb52 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:56.174433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5840e5-a943-4320-9144-3347c4a7e550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:56.175023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5840e5-a943-4320-9144-3347c4a7e550 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.175309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5840e5-a943-4320-9144-3347c4a7e550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.175587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5840e5-a943-4320-9144-3347c4a7e550 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.176229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5840e5-a943-4320-9144-3347c4a7e550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:56.177819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5840e5-a943-4320-9144-3347c4a7e550 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:56.188944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1272/2533] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:56.192786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee934-0a39-47b7-b620-4ad982e5e2fa admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:56.202670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee934-0a39-47b7-b620-4ad982e5e2fa admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:56.207355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f4ac-ebe9-451e-b649-9c3baca10a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:56.207991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f4ac-ebe9-451e-b649-9c3baca10a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.208273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f4ac-ebe9-451e-b649-9c3baca10a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.208550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f4ac-ebe9-451e-b649-9c3baca10a2e admin admin] PATH_INFO: `/v3/projects/1d8f3254d54245abb10a7873a94e189b/users/a6d7c148e1ae4c1792423a1b65e57f1e/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.223286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046f4ac-ebe9-451e-b649-9c3baca10a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8f3254d54245abb10a7873a94e189b, user_id=a6d7c148e1ae4c1792423a1b65e57f1e, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:56.225944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046f4ac-ebe9-451e-b649-9c3baca10a2e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:56.239096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1262/2534] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:56 2022] PUT /identity/v3/projects/1d8f3254d54245abb10a7873a94e189b/users/a6d7c148e1ae4c1792423a1b65e57f1e/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:56.242931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5840e5-a943-4320-9144-3347c4a7e550 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:56.252790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5840e5-a943-4320-9144-3347c4a7e550 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:56.309603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431533d6-b00d-46f9-947d-716dd2e3cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:56.310238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431533d6-b00d-46f9-947d-716dd2e3cbfc admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.310530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431533d6-b00d-46f9-947d-716dd2e3cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.310802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431533d6-b00d-46f9-947d-716dd2e3cbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.311430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431533d6-b00d-46f9-947d-716dd2e3cbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:56.313023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431533d6-b00d-46f9-947d-716dd2e3cbfc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:56.322801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1273/2535] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:56.327003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f4ac-ebe9-451e-b649-9c3baca10a2e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:56.337742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f4ac-ebe9-451e-b649-9c3baca10a2e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:56.342404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:56.343048 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.343333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.343606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] PATH_INFO: `/v3/projects/1d8f3254d54245abb10a7873a94e189b/users/a6d7c148e1ae4c1792423a1b65e57f1e/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.346144 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8f3254d54245abb10a7873a94e189b, user_id=a6d7c148e1ae4c1792423a1b65e57f1e, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:56.348800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:56.358819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1263/2536] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:56 2022] PUT /identity/v3/projects/1d8f3254d54245abb10a7873a94e189b/users/a6d7c148e1ae4c1792423a1b65e57f1e/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:56.369730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b9530-c290-4629-a1b1-16ca4376227a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.370022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b9530-c290-4629-a1b1-16ca4376227a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.370342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b9530-c290-4629-a1b1-16ca4376227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.397974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-be8b9530-c290-4629-a1b1-16ca4376227a None None] MFA Rules not processed for user `a6d7c148e1ae4c1792423a1b65e57f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:56.399211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-be8b9530-c290-4629-a1b1-16ca4376227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:56.466603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1274/2537] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:56.480428 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:56.482204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:56.551023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50bd3-1f4d-4742-a122-80ff2c24c335 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:56.554694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903b9e8-fa8b-4c6d-8603-7c8de286914c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:56.555291 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903b9e8-fa8b-4c6d-8603-7c8de286914c service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.555572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903b9e8-fa8b-4c6d-8603-7c8de286914c service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.555839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903b9e8-fa8b-4c6d-8603-7c8de286914c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.565896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903b9e8-fa8b-4c6d-8603-7c8de286914c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:56.567368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903b9e8-fa8b-4c6d-8603-7c8de286914c service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:56.577041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1264/2538] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:56.823361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b9530-c290-4629-a1b1-16ca4376227a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:56.824849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-be8b9530-c290-4629-a1b1-16ca4376227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:56.894641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b9530-c290-4629-a1b1-16ca4376227a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:56.899231 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:56.899866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:56.900150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:56.900428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] PATH_INFO: `/v3/users/405d31839c3841dc8d41734ca0fff7e0` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:56.901631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405d31839c3841dc8d41734ca0fff7e0)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:56.903583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:56.918170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:56.956797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405d31839c3841dc8d41734ca0fff7e0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:56.967723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405d31839c3841dc8d41734ca0fff7e0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:56.968529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405d31839c3841dc8d41734ca0fff7e0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:56.969263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405d31839c3841dc8d41734ca0fff7e0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:56.983707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405d31839c3841dc8d41734ca0fff7e0'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:56.996789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1275/2539] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:56 2022] DELETE /identity/v3/users/405d31839c3841dc8d41734ca0fff7e0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:57.003663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:57.004065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8a84f-8b4e-4ac5-8157-9d9b66b1e5f8 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:57.004519 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8a84f-8b4e-4ac5-8157-9d9b66b1e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:57.004890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8a84f-8b4e-4ac5-8157-9d9b66b1e5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:57.005021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:57.025301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-35e8a84f-8b4e-4ac5-8157-9d9b66b1e5f8 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:57.026628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-35e8a84f-8b4e-4ac5-8157-9d9b66b1e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:57.039493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:57.074415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069067c4-4304-48b9-b8cf-ff4fa35be126 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:57.080573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:57.081214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:57.081525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:57.082167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] PATH_INFO: `/v3/users/5fe7231ab6f84dbeb34b6c7eba896832` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:57.083455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe7231ab6f84dbeb34b6c7eba896832)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:57.085361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:57.098206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1265/2540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:57.107215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8a84f-8b4e-4ac5-8157-9d9b66b1e5f8 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:57.109404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-35e8a84f-8b4e-4ac5-8157-9d9b66b1e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:57.138872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe7231ab6f84dbeb34b6c7eba896832'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.149215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe7231ab6f84dbeb34b6c7eba896832'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.149853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe7231ab6f84dbeb34b6c7eba896832'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.150740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe7231ab6f84dbeb34b6c7eba896832'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.169866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-2c6bd2c1-c4fe-47ac-bc06-a5809189cb9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe7231ab6f84dbeb34b6c7eba896832'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.174430 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8a84f-8b4e-4ac5-8157-9d9b66b1e5f8 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:57.178327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:57.178820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:57.179103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:57.179380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:57.181151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:57.183679 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1276/2541] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:57 2022] DELETE /identity/v3/users/5fe7231ab6f84dbeb34b6c7eba896832 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:57.188507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329e4b-8fe1-44d3-a17e-64a4d9ac9e35 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:57.188813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329e4b-8fe1-44d3-a17e-64a4d9ac9e35 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:57.189454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329e4b-8fe1-44d3-a17e-64a4d9ac9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:57.196640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:57.198097 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:57.212980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:57.213150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1266/2542] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:57.219576 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8d329e4b-8fe1-44d3-a17e-64a4d9ac9e35 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:57.220828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8d329e4b-8fe1-44d3-a17e-64a4d9ac9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:57.288932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1277/2543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:57.298946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:57.300686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:57.312942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72109562-c7e1-4be5-9fec-f3dfc4a9233c service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:57.393333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e77d1-fa48-46bc-9e4c-83976c49e6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:57.394151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e77d1-fa48-46bc-9e4c-83976c49e6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:57.394534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e77d1-fa48-46bc-9e4c-83976c49e6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:57.396225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e77d1-fa48-46bc-9e4c-83976c49e6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:57.405553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e77d1-fa48-46bc-9e4c-83976c49e6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:57.407317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e77d1-fa48-46bc-9e4c-83976c49e6a7 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:57.418493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1267/2544] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:37:57.610469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329e4b-8fe1-44d3-a17e-64a4d9ac9e35 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:57.612003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8d329e4b-8fe1-44d3-a17e-64a4d9ac9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:57.624415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329e4b-8fe1-44d3-a17e-64a4d9ac9e35 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:57.630011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:57.630791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:57.631178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:57.631554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] PATH_INFO: `/v3/projects/0d22c458a8ed45788f9936b2ef8bb89e` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:57.632959 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d22c458a8ed45788f9936b2ef8bb89e)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:57.635171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:57.703261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d22c458a8ed45788f9936b2ef8bb89e', 'request_id': 'req-9891c478-001b-4fe1-a565-ac6f0754e527'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.711795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d22c458a8ed45788f9936b2ef8bb89e', 'request_id': 'req-9891c478-001b-4fe1-a565-ac6f0754e527'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.715682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d22c458a8ed45788f9936b2ef8bb89e', 'request_id': 'req-9891c478-001b-4fe1-a565-ac6f0754e527'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.729432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] The token cache is being invalidate because project 0d22c458a8ed45788f9936b2ef8bb89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:57.729660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.730321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.731804 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1278/2545] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:57 2022] DELETE /identity/v3/projects/0d22c458a8ed45788f9936b2ef8bb89e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:57.736047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e77d1-fa48-46bc-9e4c-83976c49e6a7 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:57.745956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e77d1-fa48-46bc-9e4c-83976c49e6a7 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:57.803800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:57.804433 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:57.804720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:57.804994 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] PATH_INFO: `/v3/users/e4f25d6357b54cd7a93a25537530f930` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:57.806307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f25d6357b54cd7a93a25537530f930)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:57.808288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:57.813807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:57.847000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:57.848543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:57.858623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f25d6357b54cd7a93a25537530f930'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.868870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891c478-001b-4fe1-a565-ac6f0754e527 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:57.869703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f25d6357b54cd7a93a25537530f930'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.874491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:57.875175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f25d6357b54cd7a93a25537530f930'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.876602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:57.876888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:57.877167 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] PATH_INFO: `/v3/projects/1d44ce721f924d549ee377affec1925b` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:57.881356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d44ce721f924d549ee377affec1925b)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:57.883939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:57.896616 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f25d6357b54cd7a93a25537530f930'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.912076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f25d6357b54cd7a93a25537530f930'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.920787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1268/2546] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:57 2022] DELETE /identity/v3/users/e4f25d6357b54cd7a93a25537530f930 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:57.937838 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d44ce721f924d549ee377affec1925b', 'request_id': 'req-b8213090-34a0-45bd-b808-ea54ba5e5f4f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.945917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d44ce721f924d549ee377affec1925b', 'request_id': 'req-b8213090-34a0-45bd-b808-ea54ba5e5f4f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.952485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d44ce721f924d549ee377affec1925b', 'request_id': 'req-b8213090-34a0-45bd-b808-ea54ba5e5f4f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.967376 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] The token cache is being invalidate because project 1d44ce721f924d549ee377affec1925b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:57.967667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.968309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:57.969848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1279/2547] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:57 2022] DELETE /identity/v3/projects/1d44ce721f924d549ee377affec1925b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:57.974361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:57.975859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.045661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988713d0-38dc-490e-ac33-71117bceaf09 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.107213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.107854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.108138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.108768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] PATH_INFO: `/v3/users/a6d7c148e1ae4c1792423a1b65e57f1e` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.109560 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d7c148e1ae4c1792423a1b65e57f1e)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.112026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.152507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:58.164135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d7c148e1ae4c1792423a1b65e57f1e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.171006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d7c148e1ae4c1792423a1b65e57f1e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.172294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d7c148e1ae4c1792423a1b65e57f1e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.179845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d7c148e1ae4c1792423a1b65e57f1e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.193870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8b9a671e-8a31-48ee-9e78-ecc310d899fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d7c148e1ae4c1792423a1b65e57f1e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.199940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1269/2548] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:37:57 2022] DELETE /identity/v3/users/a6d7c148e1ae4c1792423a1b65e57f1e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:58.211882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.213626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.243172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8213090-34a0-45bd-b808-ea54ba5e5f4f admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.257215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:58.322188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.322831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.323111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.323384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] PATH_INFO: `/v3/projects/4c5df706e78144419b2986e246915252` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.324556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5df706e78144419b2986e246915252)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.326527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.378524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5df706e78144419b2986e246915252', 'request_id': 'req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.384264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5df706e78144419b2986e246915252', 'request_id': 'req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.390722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5df706e78144419b2986e246915252', 'request_id': 'req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.406121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] The token cache is being invalidate because project 4c5df706e78144419b2986e246915252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:58.406432 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.407047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.408569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1280/2549] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:58 2022] DELETE /identity/v3/projects/4c5df706e78144419b2986e246915252 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:37:58.413575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadfca9-07a5-4481-bc16-541fb3cc1959 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.413870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadfca9-07a5-4481-bc16-541fb3cc1959 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.414187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadfca9-07a5-4481-bc16-541fb3cc1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.433355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-fbadfca9-07a5-4481-bc16-541fb3cc1959 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:58.434610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-fbadfca9-07a5-4481-bc16-541fb3cc1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.489624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.491533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.494982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1270/2550] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:58.503236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4db58-0f72-4ad4-a8f6-2d35e1301781 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.503527 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4db58-0f72-4ad4-a8f6-2d35e1301781 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.503807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4db58-0f72-4ad4-a8f6-2d35e1301781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.505270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb3c0-e440-4e37-bd72-1e7e77ff5653 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.510533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.511200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.511441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.511744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] PATH_INFO: `/v3/projects/1d8f3254d54245abb10a7873a94e189b` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.512884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8f3254d54245abb10a7873a94e189b)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.514857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.525206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f8e4db58-0f72-4ad4-a8f6-2d35e1301781 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:58.526461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f8e4db58-0f72-4ad4-a8f6-2d35e1301781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.534437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1271/2551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:58.538465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4db58-0f72-4ad4-a8f6-2d35e1301781 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.548162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4db58-0f72-4ad4-a8f6-2d35e1301781 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.553206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.553739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.553991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.554292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.554945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:37:58.555251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.556854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.569369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1272/2552] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:37:58.571054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8f3254d54245abb10a7873a94e189b', 'request_id': 'req-0859e3c5-a1bb-4d91-a639-eba06c202f27'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.573740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.576830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8f3254d54245abb10a7873a94e189b', 'request_id': 'req-0859e3c5-a1bb-4d91-a639-eba06c202f27'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.583544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ef93-11dc-4530-93f6-2c2ec6a8374c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.584733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8f3254d54245abb10a7873a94e189b', 'request_id': 'req-0859e3c5-a1bb-4d91-a639-eba06c202f27'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.600849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] The token cache is being invalidate because project 1d8f3254d54245abb10a7873a94e189b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:37:58.601144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.601801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0859e3c5-a1bb-4d91-a639-eba06c202f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:37:58.603349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1281/2553] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:37:58 2022] DELETE /identity/v3/projects/1d8f3254d54245abb10a7873a94e189b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:58.608468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3375f-126a-43ba-9aab-4e6e2a3f6695 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.608620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3375f-126a-43ba-9aab-4e6e2a3f6695 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.609353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3375f-126a-43ba-9aab-4e6e2a3f6695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.631531 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-46a3375f-126a-43ba-9aab-4e6e2a3f6695 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:58.632753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-46a3375f-126a-43ba-9aab-4e6e2a3f6695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.647652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.648294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.648577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.648852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.649470 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.651426 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.655682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:58.682901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1273/2554] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:58.687321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.689746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.708895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1282/2555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:58.715169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:58.716685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f744bd4-925e-429a-bbde-0f9712719aa3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.716947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f744bd4-925e-429a-bbde-0f9712719aa3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.717274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f744bd4-925e-429a-bbde-0f9712719aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.746583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-4f744bd4-925e-429a-bbde-0f9712719aa3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:58.748698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4f744bd4-925e-429a-bbde-0f9712719aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.773869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16ae0-1a35-4417-adcf-716df986caec admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.778716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d7ad-64f8-4724-b59d-514c594af3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.779322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d7ad-64f8-4724-b59d-514c594af3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.779602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d7ad-64f8-4724-b59d-514c594af3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.780059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d7ad-64f8-4724-b59d-514c594af3c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.780483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d7ad-64f8-4724-b59d-514c594af3c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.782809 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d7ad-64f8-4724-b59d-514c594af3c6 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.807448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1274/2556] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:58.811352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d7ad-64f8-4724-b59d-514c594af3c6 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.822516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1283/2557] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:58.824154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d7ad-64f8-4724-b59d-514c594af3c6 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.826834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f744bd4-925e-429a-bbde-0f9712719aa3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.829303 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc70d8f-9ae2-479a-b39b-da13a8262960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.829902 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70d8f-9ae2-479a-b39b-da13a8262960 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.830212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70d8f-9ae2-479a-b39b-da13a8262960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.830481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70d8f-9ae2-479a-b39b-da13a8262960 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.831118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc70d8f-9ae2-479a-b39b-da13a8262960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.833057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc70d8f-9ae2-479a-b39b-da13a8262960 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.837457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f744bd4-925e-429a-bbde-0f9712719aa3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.842966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.843561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.843842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.844493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1275/2558] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:37:58.844640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.844828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:37:58.845196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.846920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.848270 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc70d8f-9ae2-479a-b39b-da13a8262960 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.868575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1284/2559] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:37:58.868752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc70d8f-9ae2-479a-b39b-da13a8262960 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.870395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.872612 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d7b48-0f03-45b8-8220-80cfeb9688a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.873207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d7b48-0f03-45b8-8220-80cfeb9688a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.873487 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d7b48-0f03-45b8-8220-80cfeb9688a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.873794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d7b48-0f03-45b8-8220-80cfeb9688a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.874490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d7b48-0f03-45b8-8220-80cfeb9688a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.876150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d7b48-0f03-45b8-8220-80cfeb9688a7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.880512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0063e27-45bc-41e8-9d88-f9ba23163ebe admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.885152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda52f-d052-425d-9735-0cb1845487dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.885724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda52f-d052-425d-9735-0cb1845487dd admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.886003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda52f-d052-425d-9735-0cb1845487dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.886309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda52f-d052-425d-9735-0cb1845487dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.886922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda52f-d052-425d-9735-0cb1845487dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.887056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1276/2560] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:37:58.888970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda52f-d052-425d-9735-0cb1845487dd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.890996 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d7b48-0f03-45b8-8220-80cfeb9688a7 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.903537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d7b48-0f03-45b8-8220-80cfeb9688a7 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:58.909241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e754704-aecb-4546-b63c-fed9abde9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:58.909954 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e754704-aecb-4546-b63c-fed9abde9b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.910403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e754704-aecb-4546-b63c-fed9abde9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.910682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e754704-aecb-4546-b63c-fed9abde9b55 admin admin] PATH_INFO: `/v3/projects/bd0ddad9ef5b4b11970127dd21f07772/users/7a7f1a270e634272a27041501e2c05d2/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.917862 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1285/2561] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:58.921863 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda52f-d052-425d-9735-0cb1845487dd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:58.928597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e754704-aecb-4546-b63c-fed9abde9b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0ddad9ef5b4b11970127dd21f07772, user_id=7a7f1a270e634272a27041501e2c05d2, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:58.931280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e754704-aecb-4546-b63c-fed9abde9b55 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:58.945732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1277/2562] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:58 2022] PUT /identity/v3/projects/bd0ddad9ef5b4b11970127dd21f07772/users/7a7f1a270e634272a27041501e2c05d2/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:58.958794 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a5297-d9e7-4533-a5a8-ab1b1a47066b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:58.959441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a5297-d9e7-4533-a5a8-ab1b1a47066b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:58.959721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a5297-d9e7-4533-a5a8-ab1b1a47066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:58.990532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-b27a5297-d9e7-4533-a5a8-ab1b1a47066b None None] MFA Rules not processed for user `7a7f1a270e634272a27041501e2c05d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:58.991844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b27a5297-d9e7-4533-a5a8-ab1b1a47066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:58.994826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda52f-d052-425d-9735-0cb1845487dd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.035902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:59.058499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905624-5ac1-4aee-bea7-5a630eb24f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.059049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905624-5ac1-4aee-bea7-5a630eb24f02 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.059338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905624-5ac1-4aee-bea7-5a630eb24f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.059608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905624-5ac1-4aee-bea7-5a630eb24f02 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.060236 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a905624-5ac1-4aee-bea7-5a630eb24f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.062267 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a905624-5ac1-4aee-bea7-5a630eb24f02 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.073988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1278/2563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:59.078412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a5297-d9e7-4533-a5a8-ab1b1a47066b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.089831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a5297-d9e7-4533-a5a8-ab1b1a47066b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.090547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1286/2564] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:58 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:59.094098 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905624-5ac1-4aee-bea7-5a630eb24f02 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.095378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0f4a-0511-4099-a3af-497494faf3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.095983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0f4a-0511-4099-a3af-497494faf3ab admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.096262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0f4a-0511-4099-a3af-497494faf3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.096534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0f4a-0511-4099-a3af-497494faf3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.097153 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0f4a-0511-4099-a3af-497494faf3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.099082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0f4a-0511-4099-a3af-497494faf3ab admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.105536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905624-5ac1-4aee-bea7-5a630eb24f02 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.110446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e7437-0357-4773-a2e4-c32417efa7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.111050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e7437-0357-4773-a2e4-c32417efa7bd admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.111327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e7437-0357-4773-a2e4-c32417efa7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.111603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e7437-0357-4773-a2e4-c32417efa7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.112239 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e7437-0357-4773-a2e4-c32417efa7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.113971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e7437-0357-4773-a2e4-c32417efa7bd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.126886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1287/2565] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:59.132014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1279/2566] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:59.132158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e7437-0357-4773-a2e4-c32417efa7bd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.134259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0f4a-0511-4099-a3af-497494faf3ab admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.143698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e7437-0357-4773-a2e4-c32417efa7bd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.168289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:59.204126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0f4a-0511-4099-a3af-497494faf3ab admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.209038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fa63b-7d48-4016-a014-d064d5fcbbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.209687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa63b-7d48-4016-a014-d064d5fcbbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.209999 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa63b-7d48-4016-a014-d064d5fcbbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.210262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa63b-7d48-4016-a014-d064d5fcbbe1 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.210675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b311b4-9935-456f-81de-6903243cb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.210946 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fa63b-7d48-4016-a014-d064d5fcbbe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.211273 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b311b4-9935-456f-81de-6903243cb7ba admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.211554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b311b4-9935-456f-81de-6903243cb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.211824 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b311b4-9935-456f-81de-6903243cb7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.212456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b311b4-9935-456f-81de-6903243cb7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.212947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fa63b-7d48-4016-a014-d064d5fcbbe1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.214019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b311b4-9935-456f-81de-6903243cb7ba admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.224533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1288/2567] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:37:59.228675 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b311b4-9935-456f-81de-6903243cb7ba admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.237218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1280/2568] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:59.241112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b311b4-9935-456f-81de-6903243cb7ba admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.241615 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fa63b-7d48-4016-a014-d064d5fcbbe1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.246010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fc3c-443b-4524-afcd-fb5e7215ee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.246691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fc3c-443b-4524-afcd-fb5e7215ee05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.246974 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fc3c-443b-4524-afcd-fb5e7215ee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.247246 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fc3c-443b-4524-afcd-fb5e7215ee05 admin admin] PATH_INFO: `/v3/projects/dafdac1a16a944dd917678b41dfee48c/users/6a153cda5a74450fb41fc97e05e9f1b8/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.255111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fa63b-7d48-4016-a014-d064d5fcbbe1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.261421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57052bb-dea1-4a79-9e9a-0e1f332db6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.262274 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57052bb-dea1-4a79-9e9a-0e1f332db6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.262561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57052bb-dea1-4a79-9e9a-0e1f332db6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.262838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57052bb-dea1-4a79-9e9a-0e1f332db6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.262943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fc3c-443b-4524-afcd-fb5e7215ee05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafdac1a16a944dd917678b41dfee48c, user_id=6a153cda5a74450fb41fc97e05e9f1b8, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.263488 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57052bb-dea1-4a79-9e9a-0e1f332db6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.265208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57052bb-dea1-4a79-9e9a-0e1f332db6b0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.265511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fc3c-443b-4524-afcd-fb5e7215ee05 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.280353 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1281/2569] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:37:59.282050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1289/2570] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:59 2022] PUT /identity/v3/projects/dafdac1a16a944dd917678b41dfee48c/users/6a153cda5a74450fb41fc97e05e9f1b8/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:59.283582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57052bb-dea1-4a79-9e9a-0e1f332db6b0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.292492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cc9e-1c04-4bb0-8ba8-20075cd2b029 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.292811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cc9e-1c04-4bb0-8ba8-20075cd2b029 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.293042 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cc9e-1c04-4bb0-8ba8-20075cd2b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.295744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57052bb-dea1-4a79-9e9a-0e1f332db6b0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.321866 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d9a6cc9e-1c04-4bb0-8ba8-20075cd2b029 None None] MFA Rules not processed for user `6a153cda5a74450fb41fc97e05e9f1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:59.323052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d9a6cc9e-1c04-4bb0-8ba8-20075cd2b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:59.354876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30b300-1a9e-4f0f-8d1b-8c0f62e80cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.355473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30b300-1a9e-4f0f-8d1b-8c0f62e80cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.355758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30b300-1a9e-4f0f-8d1b-8c0f62e80cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.356031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30b300-1a9e-4f0f-8d1b-8c0f62e80cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.356669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30b300-1a9e-4f0f-8d1b-8c0f62e80cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.358307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30b300-1a9e-4f0f-8d1b-8c0f62e80cd8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.374233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1282/2571] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:37:59.375453 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30b300-1a9e-4f0f-8d1b-8c0f62e80cd8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.386321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30b300-1a9e-4f0f-8d1b-8c0f62e80cd8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.391989 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c2942-6f6f-4cfb-97c5-65f7d280411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.392518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1290/2572] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:37:59.392783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2942-6f6f-4cfb-97c5-65f7d280411b admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.393420 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2942-6f6f-4cfb-97c5-65f7d280411b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.393820 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c2942-6f6f-4cfb-97c5-65f7d280411b admin admin] PATH_INFO: `/v3/projects/a1d07904925d4403be173923fb9743ca/users/37b5369abd294453960bbe8cc65d6bc3/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.397025 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6cc9e-1c04-4bb0-8ba8-20075cd2b029 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.407463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6cc9e-1c04-4bb0-8ba8-20075cd2b029 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.410833 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c2942-6f6f-4cfb-97c5-65f7d280411b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d07904925d4403be173923fb9743ca, user_id=37b5369abd294453960bbe8cc65d6bc3, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.412190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc530abd-cb95-4a0d-94da-76071a1d35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.412998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc530abd-cb95-4a0d-94da-76071a1d35b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.413278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc530abd-cb95-4a0d-94da-76071a1d35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.413784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc530abd-cb95-4a0d-94da-76071a1d35b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.414098 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c2942-6f6f-4cfb-97c5-65f7d280411b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.414206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc530abd-cb95-4a0d-94da-76071a1d35b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.416074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc530abd-cb95-4a0d-94da-76071a1d35b7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.439258 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1283/2573] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:59 2022] PUT /identity/v3/projects/a1d07904925d4403be173923fb9743ca/users/37b5369abd294453960bbe8cc65d6bc3/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:59.439483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:59.441509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa482f-7dd5-47ed-98f8-b08aa0659626 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.441934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa482f-7dd5-47ed-98f8-b08aa0659626 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.442490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa482f-7dd5-47ed-98f8-b08aa0659626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.446388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1291/2574] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:59.450212 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc530abd-cb95-4a0d-94da-76071a1d35b7 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.478640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f3aa482f-7dd5-47ed-98f8-b08aa0659626 None None] MFA Rules not processed for user `37b5369abd294453960bbe8cc65d6bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:59.479710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f3aa482f-7dd5-47ed-98f8-b08aa0659626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:59.515374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc530abd-cb95-4a0d-94da-76071a1d35b7 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.522301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3dd21-2e4b-49e6-9e35-86a2b79a7f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.522894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3dd21-2e4b-49e6-9e35-86a2b79a7f7c admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.523173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3dd21-2e4b-49e6-9e35-86a2b79a7f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.523445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3dd21-2e4b-49e6-9e35-86a2b79a7f7c admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.524065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3dd21-2e4b-49e6-9e35-86a2b79a7f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.525989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3dd21-2e4b-49e6-9e35-86a2b79a7f7c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.557733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1292/2575] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:59.561108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1284/2576] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:37:59.561764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3dd21-2e4b-49e6-9e35-86a2b79a7f7c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.566035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa482f-7dd5-47ed-98f8-b08aa0659626 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.573527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3dd21-2e4b-49e6-9e35-86a2b79a7f7c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.577239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa482f-7dd5-47ed-98f8-b08aa0659626 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.578397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237aa4c-126d-4531-8eaf-aca8c11b16ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.579692 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237aa4c-126d-4531-8eaf-aca8c11b16ac admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.580075 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237aa4c-126d-4531-8eaf-aca8c11b16ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.580450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237aa4c-126d-4531-8eaf-aca8c11b16ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.581190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237aa4c-126d-4531-8eaf-aca8c11b16ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.582938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237aa4c-126d-4531-8eaf-aca8c11b16ac admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.584111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188729-6c60-4cb3-a272-170e75e305ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.584983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188729-6c60-4cb3-a272-170e75e305ab admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.585646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188729-6c60-4cb3-a272-170e75e305ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.585646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188729-6c60-4cb3-a272-170e75e305ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.586402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9188729-6c60-4cb3-a272-170e75e305ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.588290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9188729-6c60-4cb3-a272-170e75e305ab admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.594819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1293/2577] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:37:59.598028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:59.598740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237aa4c-126d-4531-8eaf-aca8c11b16ac admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.612391 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237aa4c-126d-4531-8eaf-aca8c11b16ac admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.618953 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad4660-1928-4657-a964-7472efa5c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.621716 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad4660-1928-4657-a964-7472efa5c4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.622023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad4660-1928-4657-a964-7472efa5c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.622291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad4660-1928-4657-a964-7472efa5c4cc admin admin] PATH_INFO: `/v3/projects/bf160a8aa1784884b13701d3c99fe093/users/e35ff86fcb4c474cab93d126fb7c26d5/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.626773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1285/2578] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:37:59.630534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188729-6c60-4cb3-a272-170e75e305ab admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.640945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad4660-1928-4657-a964-7472efa5c4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf160a8aa1784884b13701d3c99fe093, user_id=e35ff86fcb4c474cab93d126fb7c26d5, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.646012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad4660-1928-4657-a964-7472efa5c4cc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.661924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1294/2579] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:59 2022] PUT /identity/v3/projects/bf160a8aa1784884b13701d3c99fe093/users/e35ff86fcb4c474cab93d126fb7c26d5/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:59.665759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad4660-1928-4657-a964-7472efa5c4cc admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.703600 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188729-6c60-4cb3-a272-170e75e305ab admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.736092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad4660-1928-4657-a964-7472efa5c4cc admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.740897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8003fa-8156-43aa-be98-51a54cc223a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.741505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8003fa-8156-43aa-be98-51a54cc223a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.741793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8003fa-8156-43aa-be98-51a54cc223a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.742100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8003fa-8156-43aa-be98-51a54cc223a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.742915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8003fa-8156-43aa-be98-51a54cc223a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.744516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8003fa-8156-43aa-be98-51a54cc223a3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.756171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1295/2580] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:37:59.759742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8003fa-8156-43aa-be98-51a54cc223a3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.772100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8003fa-8156-43aa-be98-51a54cc223a3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.775759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc22cf-a6c9-4e9a-b630-753039666706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.776446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc22cf-a6c9-4e9a-b630-753039666706 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.776803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc22cf-a6c9-4e9a-b630-753039666706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.777377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc22cf-a6c9-4e9a-b630-753039666706 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.778212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc22cf-a6c9-4e9a-b630-753039666706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.778371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b023a-4c12-41c4-821a-bb033762d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.779023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b023a-4c12-41c4-821a-bb033762d051 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.779389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b023a-4c12-41c4-821a-bb033762d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.780088 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b023a-4c12-41c4-821a-bb033762d051 admin admin] PATH_INFO: `/v3/projects/bf160a8aa1784884b13701d3c99fe093/users/e35ff86fcb4c474cab93d126fb7c26d5/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.781167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc22cf-a6c9-4e9a-b630-753039666706 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.783321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b023a-4c12-41c4-821a-bb033762d051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf160a8aa1784884b13701d3c99fe093, user_id=e35ff86fcb4c474cab93d126fb7c26d5, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.786977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b023a-4c12-41c4-821a-bb033762d051 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:37:59.802037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1296/2581] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:37:59 2022] PUT /identity/v3/projects/bf160a8aa1784884b13701d3c99fe093/users/e35ff86fcb4c474cab93d126fb7c26d5/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:37:59.814220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce055-d069-4ec7-8196-680b146cb2c5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.814446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce055-d069-4ec7-8196-680b146cb2c5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.814647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce055-d069-4ec7-8196-680b146cb2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.823452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1286/2582] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:37:59.827279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc22cf-a6c9-4e9a-b630-753039666706 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:37:59.839629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc22cf-a6c9-4e9a-b630-753039666706 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:37:59.865139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8d0ce055-d069-4ec7-8196-680b146cb2c5 None None] MFA Rules not processed for user `e35ff86fcb4c474cab93d126fb7c26d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:37:59.866765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8d0ce055-d069-4ec7-8196-680b146cb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:37:59.905072 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:59.977532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2f0a-ed4f-4afc-a194-6e66b225c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:37:59.978640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2f0a-ed4f-4afc-a194-6e66b225c34e admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:37:59.979077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2f0a-ed4f-4afc-a194-6e66b225c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:37:59.983413 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2f0a-ed4f-4afc-a194-6e66b225c34e admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:37:59.984849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc2f0a-ed4f-4afc-a194-6e66b225c34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:37:59.987041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc2f0a-ed4f-4afc-a194-6e66b225c34e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:00.007828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1297/2583] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:37:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:00.021455 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce055-d069-4ec7-8196-680b146cb2c5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:00.024680 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1287/2584] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:00.027037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2f0a-ed4f-4afc-a194-6e66b225c34e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:00.032780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8d0ce055-d069-4ec7-8196-680b146cb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:00.048093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2f0a-ed4f-4afc-a194-6e66b225c34e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:00.067151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ad38-d394-459a-846c-a5ddf7b66cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:00.068215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ad38-d394-459a-846c-a5ddf7b66cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.068661 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ad38-d394-459a-846c-a5ddf7b66cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.069101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ad38-d394-459a-846c-a5ddf7b66cf5 admin admin] PATH_INFO: `/v3/projects/0c9b52fb19004d5b9584ad28ea0d0635/users/aac09c9cf17f4c7db596039aef60e84f/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.101190 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce055-d069-4ec7-8196-680b146cb2c5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:00.105725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f9708-e458-4939-898a-75c70d3d8f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:00.106476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f9708-e458-4939-898a-75c70d3d8f51 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.106761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f9708-e458-4939-898a-75c70d3d8f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.107037 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f9708-e458-4939-898a-75c70d3d8f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.114920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ad38-d394-459a-846c-a5ddf7b66cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9b52fb19004d5b9584ad28ea0d0635, user_id=aac09c9cf17f4c7db596039aef60e84f, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:00.118827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ad38-d394-459a-846c-a5ddf7b66cf5 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:00.119171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f9708-e458-4939-898a-75c70d3d8f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:00.120453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f9708-e458-4939-898a-75c70d3d8f51 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:00.124262 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:00.131685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1298/2585] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:00.145937 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1288/2586] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:00 2022] PUT /identity/v3/projects/0c9b52fb19004d5b9584ad28ea0d0635/users/aac09c9cf17f4c7db596039aef60e84f/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:00.149740 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f9708-e458-4939-898a-75c70d3d8f51 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:00.163188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f9708-e458-4939-898a-75c70d3d8f51 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:00.171467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ad38-d394-459a-846c-a5ddf7b66cf5 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:00.236785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d686-bb52-4279-a99c-fc6f09091a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:00.237853 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d686-bb52-4279-a99c-fc6f09091a15 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.238373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d686-bb52-4279-a99c-fc6f09091a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.238833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d686-bb52-4279-a99c-fc6f09091a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.239483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7d686-bb52-4279-a99c-fc6f09091a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:00.241111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7d686-bb52-4279-a99c-fc6f09091a15 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:00.251735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ad38-d394-459a-846c-a5ddf7b66cf5 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:00.252758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1299/2587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:00.257058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d686-bb52-4279-a99c-fc6f09091a15 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:00.257248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:00.257881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.258196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.258471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] PATH_INFO: `/v3/users/6a153cda5a74450fb41fc97e05e9f1b8` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.259597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a153cda5a74450fb41fc97e05e9f1b8)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:00.261518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:00.273372 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d686-bb52-4279-a99c-fc6f09091a15 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:00.283225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eeec2-0685-4433-9e42-62e409f86fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:00.284101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eeec2-0685-4433-9e42-62e409f86fae admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.284554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eeec2-0685-4433-9e42-62e409f86fae admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.285000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eeec2-0685-4433-9e42-62e409f86fae admin admin] PATH_INFO: `/v3/projects/0c9b52fb19004d5b9584ad28ea0d0635/users/aac09c9cf17f4c7db596039aef60e84f/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.288927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eeec2-0685-4433-9e42-62e409f86fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9b52fb19004d5b9584ad28ea0d0635, user_id=aac09c9cf17f4c7db596039aef60e84f, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:00.292633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eeec2-0685-4433-9e42-62e409f86fae admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:00.309496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1300/2588] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:00 2022] PUT /identity/v3/projects/0c9b52fb19004d5b9584ad28ea0d0635/users/aac09c9cf17f4c7db596039aef60e84f/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:00.320878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184455-680c-430b-8fb4-cac2c5a99f2a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.321158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184455-680c-430b-8fb4-cac2c5a99f2a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.321535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184455-680c-430b-8fb4-cac2c5a99f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.328096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a153cda5a74450fb41fc97e05e9f1b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:00.339799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a153cda5a74450fb41fc97e05e9f1b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:00.340699 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a153cda5a74450fb41fc97e05e9f1b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:00.352191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8d184455-680c-430b-8fb4-cac2c5a99f2a None None] MFA Rules not processed for user `aac09c9cf17f4c7db596039aef60e84f`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:00.353313 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8d184455-680c-430b-8fb4-cac2c5a99f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:00.360894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a153cda5a74450fb41fc97e05e9f1b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:00.382889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8996b755-3215-464b-a65d-18bbec7cf967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a153cda5a74450fb41fc97e05e9f1b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:00.394304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:00.396496 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1289/2589] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:00 2022] DELETE /identity/v3/users/6a153cda5a74450fb41fc97e05e9f1b8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:00.402603 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3e7b2-41cc-4a57-a997-9203ccd5998c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.402860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3e7b2-41cc-4a57-a997-9203ccd5998c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.403282 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3e7b2-41cc-4a57-a997-9203ccd5998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.428062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-dbd3e7b2-41cc-4a57-a997-9203ccd5998c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:00.429613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dbd3e7b2-41cc-4a57-a997-9203ccd5998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:00.446151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1301/2590] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:00.456284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184455-680c-430b-8fb4-cac2c5a99f2a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:00.458446 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8d184455-680c-430b-8fb4-cac2c5a99f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:00.513467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1290/2591] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:00.524062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3e7b2-41cc-4a57-a997-9203ccd5998c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:00.525490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dbd3e7b2-41cc-4a57-a997-9203ccd5998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:00.543490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184455-680c-430b-8fb4-cac2c5a99f2a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:00.547511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:00.602546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3e7b2-41cc-4a57-a997-9203ccd5998c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:00.608478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:00.609112 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.609392 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.609764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.612621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6674-cf24-480e-8e2f-a4e412039a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:00.613238 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6674-cf24-480e-8e2f-a4e412039a1d service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.613523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6674-cf24-480e-8e2f-a4e412039a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.613799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6674-cf24-480e-8e2f-a4e412039a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.620190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:00.621879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:00.632792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1291/2592] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:00.686722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b6674-cf24-480e-8e2f-a4e412039a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:00.689169 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b6674-cf24-480e-8e2f-a4e412039a1d service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:00.700950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1302/2593] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:00.948443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:00.949896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:00.968599 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420bf46-4ea7-45c0-8df2-aceacd419aa5 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:00.975403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:00.976040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:00.976319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:00.976713 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] PATH_INFO: `/v3/projects/dafdac1a16a944dd917678b41dfee48c` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:00.977956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafdac1a16a944dd917678b41dfee48c)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:00.980096 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:01.052696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafdac1a16a944dd917678b41dfee48c', 'request_id': 'req-f6a46351-c4dd-4e17-930c-548d2c9fe97e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.061201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafdac1a16a944dd917678b41dfee48c', 'request_id': 'req-f6a46351-c4dd-4e17-930c-548d2c9fe97e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.069914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafdac1a16a944dd917678b41dfee48c', 'request_id': 'req-f6a46351-c4dd-4e17-930c-548d2c9fe97e'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.108675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] The token cache is being invalidate because project dafdac1a16a944dd917678b41dfee48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:01.109072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.110729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.131210 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1292/2594] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:00 2022] DELETE /identity/v3/projects/dafdac1a16a944dd917678b41dfee48c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:01.135218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6674-cf24-480e-8e2f-a4e412039a1d service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:01.156220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6674-cf24-480e-8e2f-a4e412039a1d service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:01.225431 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:01.279498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:01.281012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:01.283544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:01.283544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] PATH_INFO: `/v3/users/e35ff86fcb4c474cab93d126fb7c26d5` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:01.283765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35ff86fcb4c474cab93d126fb7c26d5)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:01.286881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:01.374134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:01.376182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:01.449986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46351-c4dd-4e17-930c-548d2c9fe97e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:01.456016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2743e36-a3c0-4524-9a7c-67d1344df5cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:01.456640 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743e36-a3c0-4524-9a7c-67d1344df5cf service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:01.456928 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743e36-a3c0-4524-9a7c-67d1344df5cf service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:01.457250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743e36-a3c0-4524-9a7c-67d1344df5cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:01.459037 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a2743e36-a3c0-4524-9a7c-67d1344df5cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:01.484319 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35ff86fcb4c474cab93d126fb7c26d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.493587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35ff86fcb4c474cab93d126fb7c26d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.494516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35ff86fcb4c474cab93d126fb7c26d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.495197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35ff86fcb4c474cab93d126fb7c26d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.509010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35ff86fcb4c474cab93d126fb7c26d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:01.527792 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:01.530663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2743e36-a3c0-4524-9a7c-67d1344df5cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:01.533075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2743e36-a3c0-4524-9a7c-67d1344df5cf service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:01.534444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1303/2595] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:01 2022] DELETE /identity/v3/users/e35ff86fcb4c474cab93d126fb7c26d5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:01.543650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1293/2596] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:01.861451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:01.862882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:01.979943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63602703-046f-4d15-9f1a-fa887974e157 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:01.985674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:01.986342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:01.986616 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:01.986884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] PATH_INFO: `/v3/projects/bf160a8aa1784884b13701d3c99fe093` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:01.987999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf160a8aa1784884b13701d3c99fe093)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:01.989901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.039906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf160a8aa1784884b13701d3c99fe093', 'request_id': 'req-61b05e13-bb8d-43ed-ad79-304efa035e09'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:02.045402 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf160a8aa1784884b13701d3c99fe093', 'request_id': 'req-61b05e13-bb8d-43ed-ad79-304efa035e09'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:02.046657 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:02.053976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf160a8aa1784884b13701d3c99fe093', 'request_id': 'req-61b05e13-bb8d-43ed-ad79-304efa035e09'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:02.069115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] The token cache is being invalidate because project bf160a8aa1784884b13701d3c99fe093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:02.069401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:02.070006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-61b05e13-bb8d-43ed-ad79-304efa035e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:02.071500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1304/2597] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:01 2022] DELETE /identity/v3/projects/bf160a8aa1784884b13701d3c99fe093 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:02.076298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a992-38ca-46d9-9cf6-d2d90f291c18 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.076663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a992-38ca-46d9-9cf6-d2d90f291c18 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.077012 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a992-38ca-46d9-9cf6-d2d90f291c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.096845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-86e4a992-38ca-46d9-9cf6-d2d90f291c18 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:02.098049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-86e4a992-38ca-46d9-9cf6-d2d90f291c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:02.155432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1294/2598] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:02.163368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d4b2-f557-46d8-bfb4-a0c5d014bc0f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.163683 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d4b2-f557-46d8-bfb4-a0c5d014bc0f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.163958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d4b2-f557-46d8-bfb4-a0c5d014bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.184228 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-abc6d4b2-f557-46d8-bfb4-a0c5d014bc0f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:02.185547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-abc6d4b2-f557-46d8-bfb4-a0c5d014bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:02.193718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1305/2599] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:02.197921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4a992-38ca-46d9-9cf6-d2d90f291c18 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.207552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4a992-38ca-46d9-9cf6-d2d90f291c18 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.212064 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.212646 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.212927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.213195 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.213838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:02.214204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.216013 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.228377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1295/2600] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:38:02.232461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d4b2-f557-46d8-bfb4-a0c5d014bc0f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.244831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d4b2-f557-46d8-bfb4-a0c5d014bc0f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.249522 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402757eb-5670-403f-a951-d77906326fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.250173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402757eb-5670-403f-a951-d77906326fcd admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.250453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402757eb-5670-403f-a951-d77906326fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.250722 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402757eb-5670-403f-a951-d77906326fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.252672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402757eb-5670-403f-a951-d77906326fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.255285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402757eb-5670-403f-a951-d77906326fcd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.287769 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1306/2601] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:02 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:02.292259 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.302412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94049ea-766e-4540-87c9-d6ae03831bc1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.360111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afb9e7-a608-431a-81fc-aa195555d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.360880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afb9e7-a608-431a-81fc-aa195555d8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.361170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afb9e7-a608-431a-81fc-aa195555d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.361443 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afb9e7-a608-431a-81fc-aa195555d8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.362092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afb9e7-a608-431a-81fc-aa195555d8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.364065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afb9e7-a608-431a-81fc-aa195555d8a0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.385205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1296/2602] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:02 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:02.389605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402757eb-5670-403f-a951-d77906326fcd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.401003 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402757eb-5670-403f-a951-d77906326fcd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.405946 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81654ab0-1e88-4fb4-9a19-a1849a537e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.406498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81654ab0-1e88-4fb4-9a19-a1849a537e5a admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.407387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81654ab0-1e88-4fb4-9a19-a1849a537e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.407664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81654ab0-1e88-4fb4-9a19-a1849a537e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.408292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81654ab0-1e88-4fb4-9a19-a1849a537e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.409860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81654ab0-1e88-4fb4-9a19-a1849a537e5a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.419545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1307/2603] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:02.423520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afb9e7-a608-431a-81fc-aa195555d8a0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.433306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afb9e7-a608-431a-81fc-aa195555d8a0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.437831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d74558-3a7d-4dc4-82b0-b11b1e0f0892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.438444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74558-3a7d-4dc4-82b0-b11b1e0f0892 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.438725 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74558-3a7d-4dc4-82b0-b11b1e0f0892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.438995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74558-3a7d-4dc4-82b0-b11b1e0f0892 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.439634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d74558-3a7d-4dc4-82b0-b11b1e0f0892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.441254 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d74558-3a7d-4dc4-82b0-b11b1e0f0892 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.451549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1297/2604] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:02.455948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81654ab0-1e88-4fb4-9a19-a1849a537e5a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.465568 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81654ab0-1e88-4fb4-9a19-a1849a537e5a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.470808 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662811e4-9f70-479e-b49d-b7ecb6d34e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.471433 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662811e4-9f70-479e-b49d-b7ecb6d34e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.471709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662811e4-9f70-479e-b49d-b7ecb6d34e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.471980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662811e4-9f70-479e-b49d-b7ecb6d34e5a admin admin] PATH_INFO: `/v3/projects/b54965fc55c24ee09854141040720f1e/users/4d03b2c77d5849d39d18e11e2231e31f/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.486209 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662811e4-9f70-479e-b49d-b7ecb6d34e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54965fc55c24ee09854141040720f1e, user_id=4d03b2c77d5849d39d18e11e2231e31f, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.488834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662811e4-9f70-479e-b49d-b7ecb6d34e5a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.502660 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1308/2605] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:02 2022] PUT /identity/v3/projects/b54965fc55c24ee09854141040720f1e/users/4d03b2c77d5849d39d18e11e2231e31f/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:02.512783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5dd59-b20c-418a-bbd1-235d425f0dcd None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.513095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5dd59-b20c-418a-bbd1-235d425f0dcd None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.513366 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5dd59-b20c-418a-bbd1-235d425f0dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.541867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-0da5dd59-b20c-418a-bbd1-235d425f0dcd None None] MFA Rules not processed for user `4d03b2c77d5849d39d18e11e2231e31f`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:02.543123 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0da5dd59-b20c-418a-bbd1-235d425f0dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:02.596224 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:02.618085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1298/2606] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:02.622606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662811e4-9f70-479e-b49d-b7ecb6d34e5a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.683690 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662811e4-9f70-479e-b49d-b7ecb6d34e5a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.688221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1533d-1c99-4699-af9b-aea3fc4ecf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.688811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1533d-1c99-4699-af9b-aea3fc4ecf07 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.689094 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1533d-1c99-4699-af9b-aea3fc4ecf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.689371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1533d-1c99-4699-af9b-aea3fc4ecf07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.689994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1533d-1c99-4699-af9b-aea3fc4ecf07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.691928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1533d-1c99-4699-af9b-aea3fc4ecf07 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.717981 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1309/2607] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:02 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:02.722687 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5dd59-b20c-418a-bbd1-235d425f0dcd None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.733014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5dd59-b20c-418a-bbd1-235d425f0dcd None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.786908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc522743-ae68-4dd2-a078-5882e4798f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.787498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc522743-ae68-4dd2-a078-5882e4798f5f admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.787777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc522743-ae68-4dd2-a078-5882e4798f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.788057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc522743-ae68-4dd2-a078-5882e4798f5f admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.788668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc522743-ae68-4dd2-a078-5882e4798f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.790638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc522743-ae68-4dd2-a078-5882e4798f5f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.811852 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1299/2608] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:02 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:02.815828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1533d-1c99-4699-af9b-aea3fc4ecf07 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.825913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1533d-1c99-4699-af9b-aea3fc4ecf07 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.830487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d511031-66c8-4c04-8cb4-721fa95ad1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.831067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511031-66c8-4c04-8cb4-721fa95ad1db admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.831344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511031-66c8-4c04-8cb4-721fa95ad1db admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.831614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511031-66c8-4c04-8cb4-721fa95ad1db admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.832236 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d511031-66c8-4c04-8cb4-721fa95ad1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.833789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d511031-66c8-4c04-8cb4-721fa95ad1db admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.843406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1310/2609] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:02.847844 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc522743-ae68-4dd2-a078-5882e4798f5f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.858049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc522743-ae68-4dd2-a078-5882e4798f5f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.863362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509f331-53e3-4041-9530-4393526adb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.864030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509f331-53e3-4041-9530-4393526adb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.864310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509f331-53e3-4041-9530-4393526adb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.864584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509f331-53e3-4041-9530-4393526adb1e admin admin] PATH_INFO: `/v3/projects/8382a950417a49b48729ae07335780c5/users/a706d15b0d544292b61102976f42617c/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.879084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509f331-53e3-4041-9530-4393526adb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8382a950417a49b48729ae07335780c5, user_id=a706d15b0d544292b61102976f42617c, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.881735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509f331-53e3-4041-9530-4393526adb1e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.894547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1300/2610] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:02 2022] PUT /identity/v3/projects/8382a950417a49b48729ae07335780c5/users/a706d15b0d544292b61102976f42617c/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:02.898425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d511031-66c8-4c04-8cb4-721fa95ad1db admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.908796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d511031-66c8-4c04-8cb4-721fa95ad1db admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:02.959889 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:02.967066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cc8a9-9b48-4768-b5cd-5df40576b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:02.968363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc8a9-9b48-4768-b5cd-5df40576b2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:02.968655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc8a9-9b48-4768-b5cd-5df40576b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:02.969120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc8a9-9b48-4768-b5cd-5df40576b2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:02.969893 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cc8a9-9b48-4768-b5cd-5df40576b2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:02.971704 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cc8a9-9b48-4768-b5cd-5df40576b2b5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:02.981885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1311/2611] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:02.986059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509f331-53e3-4041-9530-4393526adb1e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:02.996397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509f331-53e3-4041-9530-4393526adb1e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:03.001539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:03.002444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:03.002728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:03.003004 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] PATH_INFO: `/v3/projects/8382a950417a49b48729ae07335780c5/users/a706d15b0d544292b61102976f42617c/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:03.004995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8382a950417a49b48729ae07335780c5, user_id=a706d15b0d544292b61102976f42617c, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:03.007652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:03.019092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1301/2612] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:02 2022] PUT /identity/v3/projects/8382a950417a49b48729ae07335780c5/users/a706d15b0d544292b61102976f42617c/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:03.030010 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d950f-3bb1-4949-9ebf-7d37b1e5c732 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:03.030346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d950f-3bb1-4949-9ebf-7d37b1e5c732 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:03.030620 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d950f-3bb1-4949-9ebf-7d37b1e5c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:03.059171 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-070d950f-3bb1-4949-9ebf-7d37b1e5c732 None None] MFA Rules not processed for user `a706d15b0d544292b61102976f42617c`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:03.060381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-070d950f-3bb1-4949-9ebf-7d37b1e5c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:03.170141 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1312/2613] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:04.403711 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:04.406241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:04.472069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f13b3-14cf-49a5-9042-5420ea6197ec admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:04.481342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:04.481944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:04.482268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:04.482542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:04.484255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:04.549043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:04.553667 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:04.555591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:04.565760 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1302/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:05.700147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d950f-3bb1-4949-9ebf-7d37b1e5c732 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:05.701662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-070d950f-3bb1-4949-9ebf-7d37b1e5c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:05.760867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d950f-3bb1-4949-9ebf-7d37b1e5c732 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:05.764510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:05.765128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:05.765414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:05.765684 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:05.768316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:05.830877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:05.832310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:05.842109 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1313/2615] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:07.791446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:07.793692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:07.810709 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686e415-a5b3-401d-a54d-839212872576 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:07.820861 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:07.821696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:07.822175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:07.823035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] PATH_INFO: `/v3/users/8c1dd80884d842669997cdb306ce0d39` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:07.824377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1dd80884d842669997cdb306ce0d39)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:07.826589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:07.892490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1dd80884d842669997cdb306ce0d39'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:07.906245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1dd80884d842669997cdb306ce0d39'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:07.907484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1dd80884d842669997cdb306ce0d39'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:07.916924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1dd80884d842669997cdb306ce0d39'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:07.936082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1dd80884d842669997cdb306ce0d39'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:07.945723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1303/2616] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:07 2022] DELETE /identity/v3/users/8c1dd80884d842669997cdb306ce0d39 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:08.042833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.044306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.057717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebc18e-5251-40e1-a8dc-ae823855104d service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.074978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.076777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.096410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:08.120102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.120868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.121295 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.121631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.123562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.158620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f5468-64ea-4e7c-b986-228be13e06ae admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.163699 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.164360 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.164639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.165304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] PATH_INFO: `/v3/users/7a7f1a270e634272a27041501e2c05d2` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.166230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a7f1a270e634272a27041501e2c05d2)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.168185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.202988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.205044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.214928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1314/2617] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:08.217681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.218072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a7f1a270e634272a27041501e2c05d2'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.219368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.226649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a7f1a270e634272a27041501e2c05d2'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.227358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a7f1a270e634272a27041501e2c05d2'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.235987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042edf6-b714-4183-9439-cc1e0be24c74 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.236170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a7f1a270e634272a27041501e2c05d2'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.241021 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:08.241145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.241730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.242013 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.242327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] PATH_INFO: `/v3/projects/3e637562d82f411db169011977a12cbd` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.243450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e637562d82f411db169011977a12cbd)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.245548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.252681 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f6805a42-a6ff-4af1-82ad-a0d3eeb89e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a7f1a270e634272a27041501e2c05d2'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.261998 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1304/2618] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:08 2022] DELETE /identity/v3/users/7a7f1a270e634272a27041501e2c05d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:08.263372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62b762-3074-49d6-9f2a-01c6d01b155b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.263659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62b762-3074-49d6-9f2a-01c6d01b155b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.264006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62b762-3074-49d6-9f2a-01c6d01b155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.283894 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8d62b762-3074-49d6-9f2a-01c6d01b155b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:08.285227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8d62b762-3074-49d6-9f2a-01c6d01b155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.304564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e637562d82f411db169011977a12cbd', 'request_id': 'req-ae2e8254-431b-4fe7-98ed-75e02549ce67'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.314874 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e637562d82f411db169011977a12cbd', 'request_id': 'req-ae2e8254-431b-4fe7-98ed-75e02549ce67'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.322390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e637562d82f411db169011977a12cbd', 'request_id': 'req-ae2e8254-431b-4fe7-98ed-75e02549ce67'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.337315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] The token cache is being invalidate because project 3e637562d82f411db169011977a12cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:08.337602 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.338465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ae2e8254-431b-4fe7-98ed-75e02549ce67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.340092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1315/2619] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:08 2022] DELETE /identity/v3/projects/3e637562d82f411db169011977a12cbd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:08.345213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fce5e-8c14-4203-9031-b781195dc88d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.345498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fce5e-8c14-4203-9031-b781195dc88d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.345771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fce5e-8c14-4203-9031-b781195dc88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.352664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1305/2620] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:08.362642 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62b762-3074-49d6-9f2a-01c6d01b155b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.364250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8d62b762-3074-49d6-9f2a-01c6d01b155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.367792 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-365fce5e-8c14-4203-9031-b781195dc88d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:08.368975 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-365fce5e-8c14-4203-9031-b781195dc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.378027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1316/2621] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:08.385796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3ae9c-8156-41b3-ac3a-0ba7758655ae None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.386101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3ae9c-8156-41b3-ac3a-0ba7758655ae None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.386389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3ae9c-8156-41b3-ac3a-0ba7758655ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.406417 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9ca3ae9c-8156-41b3-ac3a-0ba7758655ae None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:08.407698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9ca3ae9c-8156-41b3-ac3a-0ba7758655ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.416361 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1317/2622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:08.420566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3ae9c-8156-41b3-ac3a-0ba7758655ae None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.428534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62b762-3074-49d6-9f2a-01c6d01b155b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.430498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3ae9c-8156-41b3-ac3a-0ba7758655ae None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.432865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ceb4-1579-4326-9336-eb531bf26308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.433796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ceb4-1579-4326-9336-eb531bf26308 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.434134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ceb4-1579-4326-9336-eb531bf26308 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.434485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ceb4-1579-4326-9336-eb531bf26308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.435998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.436593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.436872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.437148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.438050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:08.438320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.439909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.444947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451ceb4-1579-4326-9336-eb531bf26308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.446457 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451ceb4-1579-4326-9336-eb531bf26308 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.452147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1318/2623] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:38:08.456839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.461142 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1306/2624] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:08.467086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f413bd-58c9-4475-81fb-419393086856 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.473827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.474505 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.474777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.475024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.475651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.477581 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.506971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1319/2625] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:08 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:08.511287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ceb4-1579-4326-9336-eb531bf26308 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.523870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ceb4-1579-4326-9336-eb531bf26308 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.577475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.580101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.597773 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621cd3a-8643-487f-90f7-f42480ca954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.598563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621cd3a-8643-487f-90f7-f42480ca954e admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.598938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621cd3a-8643-487f-90f7-f42480ca954e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.599284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621cd3a-8643-487f-90f7-f42480ca954e admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.600318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621cd3a-8643-487f-90f7-f42480ca954e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.603138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621cd3a-8643-487f-90f7-f42480ca954e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.604897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:08.630915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1307/2626] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:08 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:08.635729 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621cd3a-8643-487f-90f7-f42480ca954e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.647354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621cd3a-8643-487f-90f7-f42480ca954e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.652207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4c78-320b-4ee6-bce2-babe92c37617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.652867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4c78-320b-4ee6-bce2-babe92c37617 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.653216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4c78-320b-4ee6-bce2-babe92c37617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.653556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4c78-320b-4ee6-bce2-babe92c37617 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.654299 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee4c78-320b-4ee6-bce2-babe92c37617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.656271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee4c78-320b-4ee6-bce2-babe92c37617 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.667775 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8791-530d-47e8-8ec8-ef4875a1bf2c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.668778 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1308/2627] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:08.672477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4c78-320b-4ee6-bce2-babe92c37617 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.673286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a706d15b0d544292b61102976f42617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8382a950417a49b48729ae07335780c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.673910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.674233 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.675017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.675163 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:08.675444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.677133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.684082 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4c78-320b-4ee6-bce2-babe92c37617 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.690318 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1320/2628] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:38:08.693869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e9cd1-552f-4d1e-adcf-84c8d30ff050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.694317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.694520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9cd1-552f-4d1e-adcf-84c8d30ff050 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.694821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9cd1-552f-4d1e-adcf-84c8d30ff050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.695074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9cd1-552f-4d1e-adcf-84c8d30ff050 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.695727 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e9cd1-552f-4d1e-adcf-84c8d30ff050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.697451 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e9cd1-552f-4d1e-adcf-84c8d30ff050 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.699154 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:08.707464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdabef-981a-4731-b02c-edbb1f89ea4c tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.711463 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1309/2629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:08.714789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1a98-3d31-4b23-b517-2a7490dc8f43 tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a706d15b0d544292b61102976f42617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8382a950417a49b48729ae07335780c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.715457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1a98-3d31-4b23-b517-2a7490dc8f43 tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.715741 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1a98-3d31-4b23-b517-2a7490dc8f43 tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.715864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e9cd1-552f-4d1e-adcf-84c8d30ff050 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.716016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1a98-3d31-4b23-b517-2a7490dc8f43 tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.716645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1a98-3d31-4b23-b517-2a7490dc8f43 tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.718727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1a98-3d31-4b23-b517-2a7490dc8f43 tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.727260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e9cd1-552f-4d1e-adcf-84c8d30ff050 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.740648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11516368-233c-4155-9430-88af41644a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.741410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11516368-233c-4155-9430-88af41644a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.741746 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11516368-233c-4155-9430-88af41644a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.742251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11516368-233c-4155-9430-88af41644a87 admin admin] PATH_INFO: `/v3/projects/c4ddced581ba4d59a097c47e1bd8aa90/users/f63a3afd8da3468fb03c24c800e261f3/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.756255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1321/2630] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:08 2022] POST /identity/v3/projects => generated 354 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:08.760551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1a98-3d31-4b23-b517-2a7490dc8f43 tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.761293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11516368-233c-4155-9430-88af41644a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ddced581ba4d59a097c47e1bd8aa90, user_id=f63a3afd8da3468fb03c24c800e261f3, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.764162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11516368-233c-4155-9430-88af41644a87 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.782553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1310/2631] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:08 2022] PUT /identity/v3/projects/c4ddced581ba4d59a097c47e1bd8aa90/users/f63a3afd8da3468fb03c24c800e261f3/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:08.783317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11516368-233c-4155-9430-88af41644a87 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.785139 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-11516368-233c-4155-9430-88af41644a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.832738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1a98-3d31-4b23-b517-2a7490dc8f43 tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.862550 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11516368-233c-4155-9430-88af41644a87 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:08.867225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.867848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.868125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.868396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] PATH_INFO: `/v3/projects/bd0ddad9ef5b4b11970127dd21f07772` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.869533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0ddad9ef5b4b11970127dd21f07772)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.871475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.890605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e26b-d5ad-482a-a2e2-d81d0deb205b tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a706d15b0d544292b61102976f42617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8382a950417a49b48729ae07335780c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:08.891826 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e26b-d5ad-482a-a2e2-d81d0deb205b tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.892313 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e26b-d5ad-482a-a2e2-d81d0deb205b tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.892528 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e26b-d5ad-482a-a2e2-d81d0deb205b tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.893275 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33e26b-d5ad-482a-a2e2-d81d0deb205b tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:08.893577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33e26b-d5ad-482a-a2e2-d81d0deb205b tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:08.895198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33e26b-d5ad-482a-a2e2-d81d0deb205b tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:08.907097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1322/2632] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:38:08.911316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c511d5-535c-4159-9911-71ffac340db1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:08.911605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c511d5-535c-4159-9911-71ffac340db1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:08.911892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c511d5-535c-4159-9911-71ffac340db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:08.921143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0ddad9ef5b4b11970127dd21f07772', 'request_id': 'req-e621b772-d7b9-483c-8e8c-ee74fe7513e0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.928726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0ddad9ef5b4b11970127dd21f07772', 'request_id': 'req-e621b772-d7b9-483c-8e8c-ee74fe7513e0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.935552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0ddad9ef5b4b11970127dd21f07772', 'request_id': 'req-e621b772-d7b9-483c-8e8c-ee74fe7513e0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.945688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-48c511d5-535c-4159-9911-71ffac340db1 None None] MFA Rules not processed for user `f63a3afd8da3468fb03c24c800e261f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:08.946560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-48c511d5-535c-4159-9911-71ffac340db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.955520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] The token cache is being invalidate because project bd0ddad9ef5b4b11970127dd21f07772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:08.955814 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.957131 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:08.958660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1311/2633] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:08 2022] DELETE /identity/v3/projects/bd0ddad9ef5b4b11970127dd21f07772 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:08.959491 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:08.960724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:08.966345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:09.015285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1323/2634] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:09.016987 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c511d5-535c-4159-9911-71ffac340db1 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:09.018760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-48c511d5-535c-4159-9911-71ffac340db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.030584 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621b772-d7b9-483c-8e8c-ee74fe7513e0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:09.035320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a706d15b0d544292b61102976f42617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8382a950417a49b48729ae07335780c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:09.035952 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:09.036237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:09.036514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] PATH_INFO: `/v3/projects/6a4dc0d2d87946b3b4a5a64e135d8ad4` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:09.038136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a4dc0d2d87946b3b4a5a64e135d8ad4)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:09.040049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:09.042706 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:09.086312 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c511d5-535c-4159-9911-71ffac340db1 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:09.092170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4dc0d2d87946b3b4a5a64e135d8ad4', 'request_id': 'req-cecc731b-c969-4c47-8a14-935204c1fb2d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.098742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4dc0d2d87946b3b4a5a64e135d8ad4', 'request_id': 'req-cecc731b-c969-4c47-8a14-935204c1fb2d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.105571 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4dc0d2d87946b3b4a5a64e135d8ad4', 'request_id': 'req-cecc731b-c969-4c47-8a14-935204c1fb2d'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.118403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] The token cache is being invalidate because project 6a4dc0d2d87946b3b4a5a64e135d8ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:09.118899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.119556 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.121060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1312/2635] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:08 2022] DELETE /identity/v3/projects/6a4dc0d2d87946b3b4a5a64e135d8ad4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:09.121970 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:09.123320 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.144653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:09.145285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:09.145565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:09.145839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] PATH_INFO: `/v3/users/37b5369abd294453960bbe8cc65d6bc3` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:09.146999 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b5369abd294453960bbe8cc65d6bc3)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:09.148897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:09.201880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b5369abd294453960bbe8cc65d6bc3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.206815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc731b-c969-4c47-8a14-935204c1fb2d tempest-VolumeQuotaClassesTest-1640087471 tempest-VolumeQuotaClassesTest-1640087471-project-admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:09.211065 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b5369abd294453960bbe8cc65d6bc3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.211693 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b5369abd294453960bbe8cc65d6bc3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.212462 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b5369abd294453960bbe8cc65d6bc3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.213081 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:09.213781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:09.214187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:09.214502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:09.216482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.226763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:09.228625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b5369abd294453960bbe8cc65d6bc3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.245130 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1324/2636] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:09 2022] DELETE /identity/v3/users/37b5369abd294453960bbe8cc65d6bc3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:09.285339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:09.287018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:09.298821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1313/2637] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:09.369081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:09.371011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.457134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67332ab-5f93-42c3-b3c9-79a7977d9c80 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:09.462284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:09.463170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:09.463546 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:09.463968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] PATH_INFO: `/v3/users/4d03b2c77d5849d39d18e11e2231e31f` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:09.465115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d03b2c77d5849d39d18e11e2231e31f)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:09.467052 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:09.526513 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d03b2c77d5849d39d18e11e2231e31f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.535922 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d03b2c77d5849d39d18e11e2231e31f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.536554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d03b2c77d5849d39d18e11e2231e31f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.537173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d03b2c77d5849d39d18e11e2231e31f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.543362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:09.544775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.559872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022b6c1-8306-44fa-a5ac-7b983dc00d8f service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:09.562406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-e8d79988-637b-4d6d-9d7f-6f4610ef4886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d03b2c77d5849d39d18e11e2231e31f'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.565102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:09.565731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:09.566014 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:09.566325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] PATH_INFO: `/v3/projects/a1d07904925d4403be173923fb9743ca` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:09.567787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d07904925d4403be173923fb9743ca)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:09.569544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:09.580645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1325/2638] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:09 2022] DELETE /identity/v3/users/4d03b2c77d5849d39d18e11e2231e31f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:09.588000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e03dd-2a4c-4549-b760-0e5d82f89637 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:09.588369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e03dd-2a4c-4549-b760-0e5d82f89637 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:09.588711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e03dd-2a4c-4549-b760-0e5d82f89637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:09.599271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:09.611328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-657e03dd-2a4c-4549-b760-0e5d82f89637 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:09.612709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-657e03dd-2a4c-4549-b760-0e5d82f89637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.635211 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d07904925d4403be173923fb9743ca', 'request_id': 'req-f45784a3-7584-40b2-9cee-fb12e283e2c5'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.642129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d07904925d4403be173923fb9743ca', 'request_id': 'req-f45784a3-7584-40b2-9cee-fb12e283e2c5'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.649057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d07904925d4403be173923fb9743ca', 'request_id': 'req-f45784a3-7584-40b2-9cee-fb12e283e2c5'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.663901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] The token cache is being invalidate because project a1d07904925d4403be173923fb9743ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:09.664190 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.664806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.666462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1314/2639] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:09 2022] DELETE /identity/v3/projects/a1d07904925d4403be173923fb9743ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:09.670926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:09.674896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.707300 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1326/2640] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:09.720832 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e03dd-2a4c-4549-b760-0e5d82f89637 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:09.723523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-657e03dd-2a4c-4549-b760-0e5d82f89637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.736227 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:09.759016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45784a3-7584-40b2-9cee-fb12e283e2c5 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:09.764601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:09.765290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:09.765526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:09.765782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] PATH_INFO: `/v3/users/aac09c9cf17f4c7db596039aef60e84f` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:09.767322 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac09c9cf17f4c7db596039aef60e84f)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:09.769885 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:09.801063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e03dd-2a4c-4549-b760-0e5d82f89637 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:09.818923 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac09c9cf17f4c7db596039aef60e84f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.827514 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac09c9cf17f4c7db596039aef60e84f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.828179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac09c9cf17f4c7db596039aef60e84f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.835280 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac09c9cf17f4c7db596039aef60e84f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.847136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac09c9cf17f4c7db596039aef60e84f'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:09.853594 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1315/2641] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:09 2022] DELETE /identity/v3/users/aac09c9cf17f4c7db596039aef60e84f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:09.854676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:09.855445 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:09.855727 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:09.856005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:09.860395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:09.873208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:09.874701 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:09.884631 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1327/2642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:10.259756 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.261275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:10.303337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:10.327370 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.330596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:10.343764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e051c7-374c-4121-a805-4b3c5044576e service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.346192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2a03-53db-4562-ad1e-dfae449cbc2e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.348630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.349264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.349547 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.349865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] PATH_INFO: `/v3/projects/b54965fc55c24ee09854141040720f1e` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.350972 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54965fc55c24ee09854141040720f1e)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.351113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.351819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.352156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.352551 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] PATH_INFO: `/v3/projects/0c9b52fb19004d5b9584ad28ea0d0635` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.352994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.353830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9b52fb19004d5b9584ad28ea0d0635)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.356118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.403325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9b52fb19004d5b9584ad28ea0d0635', 'request_id': 'req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.403779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54965fc55c24ee09854141040720f1e', 'request_id': 'req-83732891-44e1-4575-9643-03da04d648ca'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.409585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9b52fb19004d5b9584ad28ea0d0635', 'request_id': 'req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.410218 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54965fc55c24ee09854141040720f1e', 'request_id': 'req-83732891-44e1-4575-9643-03da04d648ca'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.416205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9b52fb19004d5b9584ad28ea0d0635', 'request_id': 'req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.417608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54965fc55c24ee09854141040720f1e', 'request_id': 'req-83732891-44e1-4575-9643-03da04d648ca'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.429108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] The token cache is being invalidate because project 0c9b52fb19004d5b9584ad28ea0d0635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:10.429483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.430206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.431848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1316/2643] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:10 2022] DELETE /identity/v3/projects/0c9b52fb19004d5b9584ad28ea0d0635 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:10.431968 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] The token cache is being invalidate because project b54965fc55c24ee09854141040720f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:10.432259 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.432864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-83732891-44e1-4575-9643-03da04d648ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.434450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1328/2644] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:10 2022] DELETE /identity/v3/projects/b54965fc55c24ee09854141040720f1e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:10.438940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.440518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:10.441533 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccba2d-5e2f-47fa-b79e-7884e14befe1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.441842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccba2d-5e2f-47fa-b79e-7884e14befe1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.442137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccba2d-5e2f-47fa-b79e-7884e14befe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.461415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-1cccba2d-5e2f-47fa-b79e-7884e14befe1 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:10.462624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-1cccba2d-5e2f-47fa-b79e-7884e14befe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:10.506104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022880c4-2ce5-4c0a-97fe-3fcde8d1ab92 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.507385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:10.511245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.511901 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.512137 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.512411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] PATH_INFO: `/v3/users/a706d15b0d544292b61102976f42617c` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.513629 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a706d15b0d544292b61102976f42617c)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.515580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.524286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1329/2645] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:10.532627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfb1f-9241-44e2-a107-6b5e7e80fb36 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.532916 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfb1f-9241-44e2-a107-6b5e7e80fb36 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.533196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfb1f-9241-44e2-a107-6b5e7e80fb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.552879 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d3edfb1f-9241-44e2-a107-6b5e7e80fb36 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:10.554260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d3edfb1f-9241-44e2-a107-6b5e7e80fb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:10.562798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1330/2646] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:10.566215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a706d15b0d544292b61102976f42617c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.566619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfb1f-9241-44e2-a107-6b5e7e80fb36 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.573859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a706d15b0d544292b61102976f42617c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.574520 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a706d15b0d544292b61102976f42617c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.575994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfb1f-9241-44e2-a107-6b5e7e80fb36 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.581147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.581726 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.582006 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.582150 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a706d15b0d544292b61102976f42617c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.582311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.582942 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:10.583257 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.583372 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:10.584875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.597113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1331/2647] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:38:10.598246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a706d15b0d544292b61102976f42617c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:10.602399 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.604073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:10.604925 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1317/2648] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:10 2022] DELETE /identity/v3/users/a706d15b0d544292b61102976f42617c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:10.617905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5c47-14a2-47ff-9653-deb603e96fac admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.679176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c9d1-8a51-47d0-8b90-53716f5167b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.679840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c9d1-8a51-47d0-8b90-53716f5167b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.680173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c9d1-8a51-47d0-8b90-53716f5167b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.680414 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c9d1-8a51-47d0-8b90-53716f5167b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.681144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82c9d1-8a51-47d0-8b90-53716f5167b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.683121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82c9d1-8a51-47d0-8b90-53716f5167b3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.715799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1332/2649] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:10 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:10.716673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.726802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d6186-adf4-46b3-bc4e-02b509eb29d8 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.791531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035a825-0a56-420a-9c4b-28e2bf306f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.792271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035a825-0a56-420a-9c4b-28e2bf306f70 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.792558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035a825-0a56-420a-9c4b-28e2bf306f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.792831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035a825-0a56-420a-9c4b-28e2bf306f70 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.793460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035a825-0a56-420a-9c4b-28e2bf306f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.795405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035a825-0a56-420a-9c4b-28e2bf306f70 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.822302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1318/2650] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:10 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:10.825374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c9d1-8a51-47d0-8b90-53716f5167b3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.839332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c9d1-8a51-47d0-8b90-53716f5167b3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.847162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.847777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.848060 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.848331 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.848990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.850635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.865834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1333/2651] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:10.869580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035a825-0a56-420a-9c4b-28e2bf306f70 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.880019 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035a825-0a56-420a-9c4b-28e2bf306f70 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.885631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a296420-004f-4aa4-a470-7e9adf0b672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.886263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a296420-004f-4aa4-a470-7e9adf0b672c admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.886546 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a296420-004f-4aa4-a470-7e9adf0b672c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.886818 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a296420-004f-4aa4-a470-7e9adf0b672c admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.887461 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a296420-004f-4aa4-a470-7e9adf0b672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.889051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a296420-004f-4aa4-a470-7e9adf0b672c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.906325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1319/2652] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:10.906876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.909031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:10.909326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a296420-004f-4aa4-a470-7e9adf0b672c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:10.927281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1d8f7-35bc-42f2-9016-584de8f46bdb admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.930644 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a296420-004f-4aa4-a470-7e9adf0b672c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:10.942647 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.943658 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.943782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a20f50-20db-417e-8375-dde06b6efb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:10.944244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.944478 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a20f50-20db-417e-8375-dde06b6efb97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.944689 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] PATH_INFO: `/v3/projects/8382a950417a49b48729ae07335780c5` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.944804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a20f50-20db-417e-8375-dde06b6efb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.945023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a20f50-20db-417e-8375-dde06b6efb97 admin admin] PATH_INFO: `/v3/projects/801bf19b49674f8394d8fd154537c4ed/users/b1dd3bf7234c419d80efe4d1828e996b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:10.946472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8382a950417a49b48729ae07335780c5)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.949011 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.964403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a20f50-20db-417e-8375-dde06b6efb97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801bf19b49674f8394d8fd154537c4ed, user_id=b1dd3bf7234c419d80efe4d1828e996b, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:10.967908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a20f50-20db-417e-8375-dde06b6efb97 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:10.995493 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1320/2653] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:10 2022] PUT /identity/v3/projects/801bf19b49674f8394d8fd154537c4ed/users/b1dd3bf7234c419d80efe4d1828e996b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:10.998054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a49b7-917a-48db-bdfc-e3777d113bc1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:10.998510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a49b7-917a-48db-bdfc-e3777d113bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:10.998826 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a49b7-917a-48db-bdfc-e3777d113bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.007664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8382a950417a49b48729ae07335780c5', 'request_id': 'req-99cb9c72-1527-4640-b27d-b189dbac61a7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:11.014543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8382a950417a49b48729ae07335780c5', 'request_id': 'req-99cb9c72-1527-4640-b27d-b189dbac61a7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:11.022952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8382a950417a49b48729ae07335780c5', 'request_id': 'req-99cb9c72-1527-4640-b27d-b189dbac61a7'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:11.037396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f15a49b7-917a-48db-bdfc-e3777d113bc1 None None] MFA Rules not processed for user `b1dd3bf7234c419d80efe4d1828e996b`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:11.038545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] The token cache is being invalidate because project 8382a950417a49b48729ae07335780c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:11.038812 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f15a49b7-917a-48db-bdfc-e3777d113bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:11.038986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:11.039570 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-99cb9c72-1527-4640-b27d-b189dbac61a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:11.041110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1334/2654] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:10 2022] DELETE /identity/v3/projects/8382a950417a49b48729ae07335780c5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:11.046529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485eb8a-988d-439f-ab42-87857bca3b30 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.046744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485eb8a-988d-439f-ab42-87857bca3b30 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.047049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485eb8a-988d-439f-ab42-87857bca3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.069481 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b485eb8a-988d-439f-ab42-87857bca3b30 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:11.070725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b485eb8a-988d-439f-ab42-87857bca3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:11.092367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:11.118385 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1321/2655] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:11.123422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a49b7-917a-48db-bdfc-e3777d113bc1 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.124977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f15a49b7-917a-48db-bdfc-e3777d113bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:11.142543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1335/2656] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:11.144694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79106d1-e47c-41c7-a678-0ce1e97d03e3 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.145119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79106d1-e47c-41c7-a678-0ce1e97d03e3 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.145450 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79106d1-e47c-41c7-a678-0ce1e97d03e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.164606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:11.165621 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f79106d1-e47c-41c7-a678-0ce1e97d03e3 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:11.167529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f79106d1-e47c-41c7-a678-0ce1e97d03e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:11.177578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1336/2657] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:11.181973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79106d1-e47c-41c7-a678-0ce1e97d03e3 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.192997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79106d1-e47c-41c7-a678-0ce1e97d03e3 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.198582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.199255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.199542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.199812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.200447 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:11.200750 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.202476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.209448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a49b7-917a-48db-bdfc-e3777d113bc1 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.214437 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7febb11-b565-4b75-9ab7-4f122eb37433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.214907 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7febb11-b565-4b75-9ab7-4f122eb37433 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.215186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7febb11-b565-4b75-9ab7-4f122eb37433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.219490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1337/2658] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:38:11.219886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7febb11-b565-4b75-9ab7-4f122eb37433 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.219886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7febb11-b565-4b75-9ab7-4f122eb37433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.219886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7febb11-b565-4b75-9ab7-4f122eb37433 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.220473 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.232203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b4683-126f-46c8-8508-2229f33add53 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.237198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905485c-3ea7-4fe4-9222-ab92572c6f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.237809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905485c-3ea7-4fe4-9222-ab92572c6f21 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.238112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905485c-3ea7-4fe4-9222-ab92572c6f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.238388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905485c-3ea7-4fe4-9222-ab92572c6f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.239007 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905485c-3ea7-4fe4-9222-ab92572c6f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.240989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905485c-3ea7-4fe4-9222-ab92572c6f21 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.249055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1322/2659] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:11.250033 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7febb11-b565-4b75-9ab7-4f122eb37433 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.270564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1338/2660] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:11.274816 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905485c-3ea7-4fe4-9222-ab92572c6f21 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.316438 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7febb11-b565-4b75-9ab7-4f122eb37433 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.343191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905485c-3ea7-4fe4-9222-ab92572c6f21 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.348472 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb374-a18b-4668-98d3-f8ebf4fed733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.349071 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb374-a18b-4668-98d3-f8ebf4fed733 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.349381 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb374-a18b-4668-98d3-f8ebf4fed733 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.349654 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb374-a18b-4668-98d3-f8ebf4fed733 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.350309 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb374-a18b-4668-98d3-f8ebf4fed733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.352201 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb374-a18b-4668-98d3-f8ebf4fed733 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.373360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1339/2661] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:11.377360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb374-a18b-4668-98d3-f8ebf4fed733 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.377982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc790bd-51e4-4fca-a568-e82243a9a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.378637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc790bd-51e4-4fca-a568-e82243a9a67f admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.378926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc790bd-51e4-4fca-a568-e82243a9a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.379187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc790bd-51e4-4fca-a568-e82243a9a67f admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.379805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc790bd-51e4-4fca-a568-e82243a9a67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.381724 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc790bd-51e4-4fca-a568-e82243a9a67f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.387082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb374-a18b-4668-98d3-f8ebf4fed733 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.392477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb599fdb-6caa-4646-a232-418d05d0bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.393316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb599fdb-6caa-4646-a232-418d05d0bb8d admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.393591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb599fdb-6caa-4646-a232-418d05d0bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.393857 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb599fdb-6caa-4646-a232-418d05d0bb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.394514 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb599fdb-6caa-4646-a232-418d05d0bb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.396207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb599fdb-6caa-4646-a232-418d05d0bb8d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.403467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1323/2662] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:11.407176 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc790bd-51e4-4fca-a568-e82243a9a67f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.409682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1340/2663] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:11.413457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb599fdb-6caa-4646-a232-418d05d0bb8d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.417238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc790bd-51e4-4fca-a568-e82243a9a67f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.421854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3642c3-68c4-439f-ad51-73c049dd75fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.423090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3642c3-68c4-439f-ad51-73c049dd75fe admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.423369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3642c3-68c4-439f-ad51-73c049dd75fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.423645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3642c3-68c4-439f-ad51-73c049dd75fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.423941 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb599fdb-6caa-4646-a232-418d05d0bb8d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.424278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3642c3-68c4-439f-ad51-73c049dd75fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.425853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3642c3-68c4-439f-ad51-73c049dd75fe admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.428606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85126ec-7eba-453d-853f-3afcd18a5907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.429184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85126ec-7eba-453d-853f-3afcd18a5907 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.429467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85126ec-7eba-453d-853f-3afcd18a5907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.429742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85126ec-7eba-453d-853f-3afcd18a5907 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.430400 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85126ec-7eba-453d-853f-3afcd18a5907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.431943 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85126ec-7eba-453d-853f-3afcd18a5907 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.435993 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1324/2664] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:11.439974 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3642c3-68c4-439f-ad51-73c049dd75fe admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.445585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1341/2665] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:11.446563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85126ec-7eba-453d-853f-3afcd18a5907 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.450719 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3642c3-68c4-439f-ad51-73c049dd75fe admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.456199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e88da-871f-4a6d-ab77-78be8d4c0bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.456345 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85126ec-7eba-453d-853f-3afcd18a5907 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.456830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e88da-871f-4a6d-ab77-78be8d4c0bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.457109 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e88da-871f-4a6d-ab77-78be8d4c0bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.457384 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e88da-871f-4a6d-ab77-78be8d4c0bf9 admin admin] PATH_INFO: `/v3/projects/222d70ab260b48f9b2c7572db8a61a3c/users/64cf7fc1d3b14a26b0c27de0206ddf15/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.460868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a65d7-18c4-4888-af32-eb9d0d1f71c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.461486 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a65d7-18c4-4888-af32-eb9d0d1f71c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.461761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a65d7-18c4-4888-af32-eb9d0d1f71c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.462031 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a65d7-18c4-4888-af32-eb9d0d1f71c7 admin admin] PATH_INFO: `/v3/projects/936ebcebb19841eab02a4e3b68c79fb8/users/955e7e0c32584aef8e2bc7eacb209e47/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.471866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e88da-871f-4a6d-ab77-78be8d4c0bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222d70ab260b48f9b2c7572db8a61a3c, user_id=64cf7fc1d3b14a26b0c27de0206ddf15, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.474534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e88da-871f-4a6d-ab77-78be8d4c0bf9 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.476398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a65d7-18c4-4888-af32-eb9d0d1f71c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ebcebb19841eab02a4e3b68c79fb8, user_id=955e7e0c32584aef8e2bc7eacb209e47, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.479484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a65d7-18c4-4888-af32-eb9d0d1f71c7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.489265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1325/2666] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:11 2022] PUT /identity/v3/projects/222d70ab260b48f9b2c7572db8a61a3c/users/64cf7fc1d3b14a26b0c27de0206ddf15/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:11.493181 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e88da-871f-4a6d-ab77-78be8d4c0bf9 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.495575 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1342/2667] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:11 2022] PUT /identity/v3/projects/936ebcebb19841eab02a4e3b68c79fb8/users/955e7e0c32584aef8e2bc7eacb209e47/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:11.506256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:11.507315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a2fdc-6b68-4dc1-9ccc-45df5afbedaf None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.508148 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a2fdc-6b68-4dc1-9ccc-45df5afbedaf None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.508422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a2fdc-6b68-4dc1-9ccc-45df5afbedaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.537630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-ca1a2fdc-6b68-4dc1-9ccc-45df5afbedaf None None] MFA Rules not processed for user `955e7e0c32584aef8e2bc7eacb209e47`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:11.539020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-ca1a2fdc-6b68-4dc1-9ccc-45df5afbedaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:11.556549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:11.558566 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e88da-871f-4a6d-ab77-78be8d4c0bf9 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.610656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1343/2668] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:11.614986 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a2fdc-6b68-4dc1-9ccc-45df5afbedaf None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.618462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9187a8-da9c-4b31-8b72-227e8737199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.619072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9187a8-da9c-4b31-8b72-227e8737199f admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.619352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9187a8-da9c-4b31-8b72-227e8737199f admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.619626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9187a8-da9c-4b31-8b72-227e8737199f admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.620310 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9187a8-da9c-4b31-8b72-227e8737199f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.621904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9187a8-da9c-4b31-8b72-227e8737199f admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.625235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a2fdc-6b68-4dc1-9ccc-45df5afbedaf None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.629708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937f14-e3ce-45fa-b859-4dfa221186f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.630316 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937f14-e3ce-45fa-b859-4dfa221186f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.630593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937f14-e3ce-45fa-b859-4dfa221186f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.630867 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937f14-e3ce-45fa-b859-4dfa221186f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.631468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937f14-e3ce-45fa-b859-4dfa221186f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.634859 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1326/2669] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:11.635000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937f14-e3ce-45fa-b859-4dfa221186f1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.636136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9187a8-da9c-4b31-8b72-227e8737199f admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.647130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9187a8-da9c-4b31-8b72-227e8737199f admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.651733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c1503-8644-4cf8-8713-47a1fba7287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.652378 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c1503-8644-4cf8-8713-47a1fba7287e admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.652654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c1503-8644-4cf8-8713-47a1fba7287e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.652912 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c1503-8644-4cf8-8713-47a1fba7287e admin admin] PATH_INFO: `/v3/projects/222d70ab260b48f9b2c7572db8a61a3c/users/64cf7fc1d3b14a26b0c27de0206ddf15/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.654951 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c1503-8644-4cf8-8713-47a1fba7287e admin admin] RBAC: Authorizing `identity:create_grant(project_id=222d70ab260b48f9b2c7572db8a61a3c, user_id=64cf7fc1d3b14a26b0c27de0206ddf15, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.657659 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c1503-8644-4cf8-8713-47a1fba7287e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.663147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1344/2670] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:11.666878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937f14-e3ce-45fa-b859-4dfa221186f1 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.668582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1327/2671] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:11 2022] PUT /identity/v3/projects/222d70ab260b48f9b2c7572db8a61a3c/users/64cf7fc1d3b14a26b0c27de0206ddf15/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:11.679506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9487-0790-4047-bf15-5873559bdd4d None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.679799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9487-0790-4047-bf15-5873559bdd4d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.680078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9487-0790-4047-bf15-5873559bdd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.708685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-014c9487-0790-4047-bf15-5873559bdd4d None None] MFA Rules not processed for user `64cf7fc1d3b14a26b0c27de0206ddf15`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:11.709800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-014c9487-0790-4047-bf15-5873559bdd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:11.731682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937f14-e3ce-45fa-b859-4dfa221186f1 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.780864 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1328/2672] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:11.791532 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04216d-822c-4081-9c30-a6a392b2ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.792054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c9487-0790-4047-bf15-5873559bdd4d None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.792180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04216d-822c-4081-9c30-a6a392b2ed06 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.792398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04216d-822c-4081-9c30-a6a392b2ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.792671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04216d-822c-4081-9c30-a6a392b2ed06 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.793290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04216d-822c-4081-9c30-a6a392b2ed06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.793452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-014c9487-0790-4047-bf15-5873559bdd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:11.795234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04216d-822c-4081-9c30-a6a392b2ed06 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.816545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1345/2673] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:11 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:11.820310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04216d-822c-4081-9c30-a6a392b2ed06 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.826533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:11.830373 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04216d-822c-4081-9c30-a6a392b2ed06 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.835390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d45625-ff56-41df-b532-7c1132d5e1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.835977 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d45625-ff56-41df-b532-7c1132d5e1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.836288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d45625-ff56-41df-b532-7c1132d5e1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.836562 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d45625-ff56-41df-b532-7c1132d5e1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.837196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d45625-ff56-41df-b532-7c1132d5e1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.838881 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d45625-ff56-41df-b532-7c1132d5e1c5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.849393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1346/2674] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:11.853292 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d45625-ff56-41df-b532-7c1132d5e1c5 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.854855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c9487-0790-4047-bf15-5873559bdd4d None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.859030 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a5b4-d147-4bb9-8370-efd12fced4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.860298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a5b4-d147-4bb9-8370-efd12fced4ed service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.861069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a5b4-d147-4bb9-8370-efd12fced4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.861069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a5b4-d147-4bb9-8370-efd12fced4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.864666 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d45625-ff56-41df-b532-7c1132d5e1c5 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.869365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b84f0a-25a5-4942-a126-15410987924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.870029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b84f0a-25a5-4942-a126-15410987924f admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.870421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b84f0a-25a5-4942-a126-15410987924f admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.870690 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b84f0a-25a5-4942-a126-15410987924f admin admin] PATH_INFO: `/v3/projects/165df5440cfc4a52ac7e98e95ff96100/users/536cfb975ad24a03aad8d3c0c33f5635/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.886145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b84f0a-25a5-4942-a126-15410987924f admin admin] RBAC: Authorizing `identity:create_grant(project_id=165df5440cfc4a52ac7e98e95ff96100, user_id=536cfb975ad24a03aad8d3c0c33f5635, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.888849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b84f0a-25a5-4942-a126-15410987924f admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.897965 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:11.904263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1347/2675] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:11 2022] PUT /identity/v3/projects/165df5440cfc4a52ac7e98e95ff96100/users/536cfb975ad24a03aad8d3c0c33f5635/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:11.908555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b84f0a-25a5-4942-a126-15410987924f admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:11.921504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02a5b4-d147-4bb9-8370-efd12fced4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.923577 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02a5b4-d147-4bb9-8370-efd12fced4ed service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.932565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1329/2676] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:11.970428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b84f0a-25a5-4942-a126-15410987924f admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:11.975200 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc10510-4cfd-4790-9395-862cf819362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:11.975800 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10510-4cfd-4790-9395-862cf819362c admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:11.976081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10510-4cfd-4790-9395-862cf819362c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:11.976356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10510-4cfd-4790-9395-862cf819362c admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:11.976997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc10510-4cfd-4790-9395-862cf819362c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:11.978618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc10510-4cfd-4790-9395-862cf819362c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:11.992166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1348/2677] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:11.993074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a5b4-d147-4bb9-8370-efd12fced4ed service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:12.004712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a5b4-d147-4bb9-8370-efd12fced4ed service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:12.009405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b129f7-abae-46b6-9b7b-e8f1bf2abbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:12.010054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b129f7-abae-46b6-9b7b-e8f1bf2abbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.010380 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b129f7-abae-46b6-9b7b-e8f1bf2abbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.010662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b129f7-abae-46b6-9b7b-e8f1bf2abbe9 admin admin] PATH_INFO: `/v3/projects/165df5440cfc4a52ac7e98e95ff96100/users/536cfb975ad24a03aad8d3c0c33f5635/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.012585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b129f7-abae-46b6-9b7b-e8f1bf2abbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165df5440cfc4a52ac7e98e95ff96100, user_id=536cfb975ad24a03aad8d3c0c33f5635, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:12.015243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b129f7-abae-46b6-9b7b-e8f1bf2abbe9 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:12.026668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1330/2678] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:11 2022] PUT /identity/v3/projects/165df5440cfc4a52ac7e98e95ff96100/users/536cfb975ad24a03aad8d3c0c33f5635/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:12.036724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc158c7-9756-4244-af51-480b85671ed8 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.037015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc158c7-9756-4244-af51-480b85671ed8 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.037291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc158c7-9756-4244-af51-480b85671ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.065674 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-5fc158c7-9756-4244-af51-480b85671ed8 None None] MFA Rules not processed for user `536cfb975ad24a03aad8d3c0c33f5635`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:12.066910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5fc158c7-9756-4244-af51-480b85671ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:12.141477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1349/2679] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:12.157197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b129f7-abae-46b6-9b7b-e8f1bf2abbe9 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:12.160463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc158c7-9756-4244-af51-480b85671ed8 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:12.160463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-5fc158c7-9756-4244-af51-480b85671ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:12.224175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b129f7-abae-46b6-9b7b-e8f1bf2abbe9 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:12.228732 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e6cbf-e3c7-4fe9-8be2-875897b3c6e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:12.229524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e6cbf-e3c7-4fe9-8be2-875897b3c6e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.229803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e6cbf-e3c7-4fe9-8be2-875897b3c6e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.230122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e6cbf-e3c7-4fe9-8be2-875897b3c6e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.235846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc158c7-9756-4244-af51-480b85671ed8 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:12.240799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e6cbf-e3c7-4fe9-8be2-875897b3c6e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:12.242211 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:12.242356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e6cbf-e3c7-4fe9-8be2-875897b3c6e7 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:12.242837 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.243113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.243382 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] PATH_INFO: `/v3/users/f63a3afd8da3468fb03c24c800e261f3` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.244504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63a3afd8da3468fb03c24c800e261f3)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:12.246424 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:12.254991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1331/2680] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:12.285066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:12.320436 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63a3afd8da3468fb03c24c800e261f3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.330344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63a3afd8da3468fb03c24c800e261f3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.332131 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63a3afd8da3468fb03c24c800e261f3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.333164 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63a3afd8da3468fb03c24c800e261f3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.348480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63a3afd8da3468fb03c24c800e261f3'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.365906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1350/2681] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:12 2022] DELETE /identity/v3/users/f63a3afd8da3468fb03c24c800e261f3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:12.370697 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3a5b4-480d-461b-83f5-a738c135291a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.371156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3a5b4-480d-461b-83f5-a738c135291a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.371244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3a5b4-480d-461b-83f5-a738c135291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.384947 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:12.387343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:12.392319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-50b3a5b4-480d-461b-83f5-a738c135291a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:12.393781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-50b3a5b4-480d-461b-83f5-a738c135291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:12.449317 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad5055-382e-4930-8e08-b1c63990d03c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:12.452907 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:12.453535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.453816 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.453941 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1332/2682] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:12.454102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.455901 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:12.463638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3a5b4-480d-461b-83f5-a738c135291a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:12.464983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-50b3a5b4-480d-461b-83f5-a738c135291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:12.478482 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:12.517339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:12.519048 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:12.525403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3a5b4-480d-461b-83f5-a738c135291a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:12.528454 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1351/2683] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:12.529293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a37e2-2ba0-445b-95ab-a9e7a1e72041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:12.530008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a37e2-2ba0-445b-95ab-a9e7a1e72041 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.530377 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a37e2-2ba0-445b-95ab-a9e7a1e72041 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.530717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a37e2-2ba0-445b-95ab-a9e7a1e72041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.541072 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a37e2-2ba0-445b-95ab-a9e7a1e72041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:12.542618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a37e2-2ba0-445b-95ab-a9e7a1e72041 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:12.552810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1333/2684] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:12.835426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:12.837415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:12.878306 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc228-80d2-48de-9861-f9171c29547d service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:12.882835 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:12.883457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.883735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.884008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] PATH_INFO: `/v3/projects/c4ddced581ba4d59a097c47e1bd8aa90` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.885112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ddced581ba4d59a097c47e1bd8aa90)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:12.887040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:12.934041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:12.935591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ddced581ba4d59a097c47e1bd8aa90', 'request_id': 'req-6867ff27-1b98-4402-b256-28f54c7114f9'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.943411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ddced581ba4d59a097c47e1bd8aa90', 'request_id': 'req-6867ff27-1b98-4402-b256-28f54c7114f9'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.950150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ddced581ba4d59a097c47e1bd8aa90', 'request_id': 'req-6867ff27-1b98-4402-b256-28f54c7114f9'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.963471 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] The token cache is being invalidate because project c4ddced581ba4d59a097c47e1bd8aa90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:12.963755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.964353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6867ff27-1b98-4402-b256-28f54c7114f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:12.965825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1352/2685] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:12 2022] DELETE /identity/v3/projects/c4ddced581ba4d59a097c47e1bd8aa90 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:12.972062 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048144a-4588-4751-bd15-626562c38b68 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:12.972351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048144a-4588-4751-bd15-626562c38b68 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:12.972626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048144a-4588-4751-bd15-626562c38b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:12.991795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-f048144a-4588-4751-bd15-626562c38b68 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:12.992926 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f048144a-4588-4751-bd15-626562c38b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:13.050561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1334/2686] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:13.059336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8936-253e-4868-bb34-066cb9a78f82 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.059619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8936-253e-4868-bb34-066cb9a78f82 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.059890 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8936-253e-4868-bb34-066cb9a78f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.079377 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-834b8936-253e-4868-bb34-066cb9a78f82 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:13.080557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-834b8936-253e-4868-bb34-066cb9a78f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:13.088339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1353/2687] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:13.092344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048144a-4588-4751-bd15-626562c38b68 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:13.103093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048144a-4588-4751-bd15-626562c38b68 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:13.107581 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:13.108170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.108449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.108717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.109356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:13.109696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:13.111325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:13.122791 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1335/2688] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:38:13.127254 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b8936-253e-4868-bb34-066cb9a78f82 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:13.136411 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b8936-253e-4868-bb34-066cb9a78f82 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:13.141463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b38f-54e7-41c2-a598-32709d12b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:13.142049 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b38f-54e7-41c2-a598-32709d12b24e admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.142359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b38f-54e7-41c2-a598-32709d12b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.142627 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b38f-54e7-41c2-a598-32709d12b24e admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.143500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706b38f-54e7-41c2-a598-32709d12b24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:13.145366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706b38f-54e7-41c2-a598-32709d12b24e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:13.171806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1354/2689] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:13 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:13.175839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:13.185613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549c06-73c5-4507-aba0-a554b7f9e951 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:13.244003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a487fa3-9719-47e2-9548-fdd7058f55c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:13.244521 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a487fa3-9719-47e2-9548-fdd7058f55c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.244803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a487fa3-9719-47e2-9548-fdd7058f55c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.245077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a487fa3-9719-47e2-9548-fdd7058f55c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.245689 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a487fa3-9719-47e2-9548-fdd7058f55c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:13.247720 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a487fa3-9719-47e2-9548-fdd7058f55c1 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:13.268216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1336/2690] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:13 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:13.272320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b38f-54e7-41c2-a598-32709d12b24e admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:13.282923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b38f-54e7-41c2-a598-32709d12b24e admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:13.287418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638e95b-2388-409b-b12e-8566d97c9aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:13.288001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638e95b-2388-409b-b12e-8566d97c9aab admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.288278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638e95b-2388-409b-b12e-8566d97c9aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.288544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638e95b-2388-409b-b12e-8566d97c9aab admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.289173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638e95b-2388-409b-b12e-8566d97c9aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:13.290780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638e95b-2388-409b-b12e-8566d97c9aab admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:13.301798 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1355/2691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:13.305620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a487fa3-9719-47e2-9548-fdd7058f55c1 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:13.315811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a487fa3-9719-47e2-9548-fdd7058f55c1 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:13.320419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa52422-75d8-4f0b-b350-01edeb0d1ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:13.321000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa52422-75d8-4f0b-b350-01edeb0d1ebe admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.321279 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa52422-75d8-4f0b-b350-01edeb0d1ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.321555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa52422-75d8-4f0b-b350-01edeb0d1ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.322247 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa52422-75d8-4f0b-b350-01edeb0d1ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:13.323853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa52422-75d8-4f0b-b350-01edeb0d1ebe admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:13.334316 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1337/2692] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:13.338308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638e95b-2388-409b-b12e-8566d97c9aab admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:13.348592 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638e95b-2388-409b-b12e-8566d97c9aab admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:13.353518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:13.354184 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.354464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.354736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] PATH_INFO: `/v3/projects/ca4b5065f7fe4226af786293e5b9e7ae/users/b7400568521c45b98fa89a7c9d618ee9/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.370235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4b5065f7fe4226af786293e5b9e7ae, user_id=b7400568521c45b98fa89a7c9d618ee9, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:13.373110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:13.398728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1356/2693] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:13 2022] PUT /identity/v3/projects/ca4b5065f7fe4226af786293e5b9e7ae/users/b7400568521c45b98fa89a7c9d618ee9/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:13.400327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b651dc-e761-44fb-9d62-758135feda7b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.400789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b651dc-e761-44fb-9d62-758135feda7b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.400890 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b651dc-e761-44fb-9d62-758135feda7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.431103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-13b651dc-e761-44fb-9d62-758135feda7b None None] MFA Rules not processed for user `b7400568521c45b98fa89a7c9d618ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:13.432335 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-13b651dc-e761-44fb-9d62-758135feda7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:13.440805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:13.504843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1338/2694] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:13.516342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:13.518453 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:13.593504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a108aec-bdef-487a-852d-6ddc7d70866a admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:13.600498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39e0c9-a6fc-434e-817b-765482ad690d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:13.601198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e0c9-a6fc-434e-817b-765482ad690d service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.601479 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e0c9-a6fc-434e-817b-765482ad690d service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.601745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e0c9-a6fc-434e-817b-765482ad690d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.610421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39e0c9-a6fc-434e-817b-765482ad690d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:13.612175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39e0c9-a6fc-434e-817b-765482ad690d service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:13.621864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1357/2695] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:13.839886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b651dc-e761-44fb-9d62-758135feda7b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:13.904908 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b651dc-e761-44fb-9d62-758135feda7b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:13.909421 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:13.910038 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:13.910358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:13.910634 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] PATH_INFO: `/v3/users/b7400568521c45b98fa89a7c9d618ee9` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:13.911765 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7400568521c45b98fa89a7c9d618ee9)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:13.913639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:13.963147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7400568521c45b98fa89a7c9d618ee9'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:13.971449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7400568521c45b98fa89a7c9d618ee9'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:13.972168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7400568521c45b98fa89a7c9d618ee9'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:13.979750 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7400568521c45b98fa89a7c9d618ee9'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:13.996835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7400568521c45b98fa89a7c9d618ee9'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:14.003848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1339/2696] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:13 2022] DELETE /identity/v3/users/b7400568521c45b98fa89a7c9d618ee9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:14.008263 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81652-04b6-4637-98d9-5f628d6bdab2 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.008519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81652-04b6-4637-98d9-5f628d6bdab2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.008821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81652-04b6-4637-98d9-5f628d6bdab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.029341 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-78e81652-04b6-4637-98d9-5f628d6bdab2 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:14.030577 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-78e81652-04b6-4637-98d9-5f628d6bdab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:14.088918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:14.102299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1358/2697] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:14.111742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:14.113266 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:14.146300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:14.174047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79500e-980a-4d2d-8f83-dc4c4f748557 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:14.177684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef14591-5cf2-4b77-a06c-bbb339aa5669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:14.178325 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14591-5cf2-4b77-a06c-bbb339aa5669 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.178608 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14591-5cf2-4b77-a06c-bbb339aa5669 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.179086 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14591-5cf2-4b77-a06c-bbb339aa5669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.188245 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14591-5cf2-4b77-a06c-bbb339aa5669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:14.189949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14591-5cf2-4b77-a06c-bbb339aa5669 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:14.199403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1340/2698] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:14.479449 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e81652-04b6-4637-98d9-5f628d6bdab2 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:14.480899 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-78e81652-04b6-4637-98d9-5f628d6bdab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:14.493057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e81652-04b6-4637-98d9-5f628d6bdab2 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:14.497903 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:14.498571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.498869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.499143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] PATH_INFO: `/v3/projects/ca4b5065f7fe4226af786293e5b9e7ae` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.500310 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4b5065f7fe4226af786293e5b9e7ae)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:14.502342 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:14.548375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4b5065f7fe4226af786293e5b9e7ae', 'request_id': 'req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:14.553625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4b5065f7fe4226af786293e5b9e7ae', 'request_id': 'req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:14.559788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4b5065f7fe4226af786293e5b9e7ae', 'request_id': 'req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:14.571582 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] The token cache is being invalidate because project ca4b5065f7fe4226af786293e5b9e7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:14.571868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:14.572477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6c779acf-b5dd-4269-9f9f-d034c2c3d3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:14.573919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1359/2699] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:14 2022] DELETE /identity/v3/projects/ca4b5065f7fe4226af786293e5b9e7ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:14.579216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d6df-d2a4-4cc0-9c3d-d8fa7926e409 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.579670 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d6df-d2a4-4cc0-9c3d-d8fa7926e409 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.579799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d6df-d2a4-4cc0-9c3d-d8fa7926e409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.599633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-42e7d6df-d2a4-4cc0-9c3d-d8fa7926e409 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:14.600856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-42e7d6df-d2a4-4cc0-9c3d-d8fa7926e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:14.657648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1341/2700] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:14.665516 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d074-ed9f-4c01-bf64-d60f1fff5917 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.665809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d074-ed9f-4c01-bf64-d60f1fff5917 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.666121 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d074-ed9f-4c01-bf64-d60f1fff5917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.686325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-47c0d074-ed9f-4c01-bf64-d60f1fff5917 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:14.688024 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-47c0d074-ed9f-4c01-bf64-d60f1fff5917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:14.695665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1360/2701] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:14.699742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d6df-d2a4-4cc0-9c3d-d8fa7926e409 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:14.709741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d6df-d2a4-4cc0-9c3d-d8fa7926e409 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:14.714223 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:14.714806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.715083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.715351 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.715981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:14.716276 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:14.717855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:14.729003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1342/2702] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:38:14.733046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0d074-ed9f-4c01-bf64-d60f1fff5917 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:14.742203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0d074-ed9f-4c01-bf64-d60f1fff5917 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:14.746789 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfce28-167e-46ef-915d-f9b0d2093db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:14.747366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfce28-167e-46ef-915d-f9b0d2093db0 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.747644 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfce28-167e-46ef-915d-f9b0d2093db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.747911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfce28-167e-46ef-915d-f9b0d2093db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.748551 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfce28-167e-46ef-915d-f9b0d2093db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:14.750980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfce28-167e-46ef-915d-f9b0d2093db0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:14.779299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1361/2703] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:14 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:14.783601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:14.793782 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e7c4f-1bea-4875-8f15-2d4ca7fd82b0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:14.863897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac29b1f-0d68-4dfa-9cee-76388aacac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:14.864838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac29b1f-0d68-4dfa-9cee-76388aacac74 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.865125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac29b1f-0d68-4dfa-9cee-76388aacac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.865404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac29b1f-0d68-4dfa-9cee-76388aacac74 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.866120 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac29b1f-0d68-4dfa-9cee-76388aacac74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:14.868064 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac29b1f-0d68-4dfa-9cee-76388aacac74 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:14.894216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1343/2704] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:14 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:14.898608 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfce28-167e-46ef-915d-f9b0d2093db0 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:14.909220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfce28-167e-46ef-915d-f9b0d2093db0 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:14.914322 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185dd2e-c1e3-4a4a-9cda-0115752efcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:14.914951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185dd2e-c1e3-4a4a-9cda-0115752efcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.915367 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185dd2e-c1e3-4a4a-9cda-0115752efcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.915664 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185dd2e-c1e3-4a4a-9cda-0115752efcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.916371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185dd2e-c1e3-4a4a-9cda-0115752efcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:14.917982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185dd2e-c1e3-4a4a-9cda-0115752efcf2 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:14.931469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1362/2705] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:14.932653 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac29b1f-0d68-4dfa-9cee-76388aacac74 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:14.944164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac29b1f-0d68-4dfa-9cee-76388aacac74 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:14.949047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836799c-7650-4758-91a5-f36320c71b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:14.949759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836799c-7650-4758-91a5-f36320c71b42 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.950134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836799c-7650-4758-91a5-f36320c71b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.950480 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836799c-7650-4758-91a5-f36320c71b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.951130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836799c-7650-4758-91a5-f36320c71b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:14.952836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836799c-7650-4758-91a5-f36320c71b42 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:14.963479 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1344/2706] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:14.967617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185dd2e-c1e3-4a4a-9cda-0115752efcf2 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:14.977944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185dd2e-c1e3-4a4a-9cda-0115752efcf2 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:14.982564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455348f-f1b9-4e45-805e-838093d922f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:14.983214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455348f-f1b9-4e45-805e-838093d922f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:14.983499 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455348f-f1b9-4e45-805e-838093d922f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:14.983773 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455348f-f1b9-4e45-805e-838093d922f2 admin admin] PATH_INFO: `/v3/projects/3e7ac236292f423d8eb5eb7b452c2e55/users/49fc5c312fab44358d6fdd3e20dff94b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:14.998781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455348f-f1b9-4e45-805e-838093d922f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7ac236292f423d8eb5eb7b452c2e55, user_id=49fc5c312fab44358d6fdd3e20dff94b, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.001958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455348f-f1b9-4e45-805e-838093d922f2 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.015623 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1363/2707] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:14 2022] PUT /identity/v3/projects/3e7ac236292f423d8eb5eb7b452c2e55/users/49fc5c312fab44358d6fdd3e20dff94b/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:15.027314 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78338-014f-4ffb-add2-27dbb094495c None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.027740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78338-014f-4ffb-add2-27dbb094495c None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.027867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78338-014f-4ffb-add2-27dbb094495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.056271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-47a78338-014f-4ffb-add2-27dbb094495c None None] MFA Rules not processed for user `49fc5c312fab44358d6fdd3e20dff94b`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:15.057688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-47a78338-014f-4ffb-add2-27dbb094495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:15.092707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:15.140201 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1345/2708] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:15.144748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455348f-f1b9-4e45-805e-838093d922f2 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.164985 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a78338-014f-4ffb-add2-27dbb094495c None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.166425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-47a78338-014f-4ffb-add2-27dbb094495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:15.217299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455348f-f1b9-4e45-805e-838093d922f2 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.222330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cdbaf-f1b1-4ba7-903f-b03f9f267c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.222928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cdbaf-f1b1-4ba7-903f-b03f9f267c02 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.223207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cdbaf-f1b1-4ba7-903f-b03f9f267c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.223484 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cdbaf-f1b1-4ba7-903f-b03f9f267c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.224088 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cdbaf-f1b1-4ba7-903f-b03f9f267c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.225963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cdbaf-f1b1-4ba7-903f-b03f9f267c02 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.236365 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a78338-014f-4ffb-add2-27dbb094495c None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.241124 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.241842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.242284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.242645 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] PATH_INFO: `/v3/users/955e7e0c32584aef8e2bc7eacb209e47` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.244025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955e7e0c32584aef8e2bc7eacb209e47)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.246403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.253739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1364/2709] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:15 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:15.258356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cdbaf-f1b1-4ba7-903f-b03f9f267c02 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.263153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:15.294218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955e7e0c32584aef8e2bc7eacb209e47'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:15.302542 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955e7e0c32584aef8e2bc7eacb209e47'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:15.303188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955e7e0c32584aef8e2bc7eacb209e47'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:15.310725 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955e7e0c32584aef8e2bc7eacb209e47'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:15.323787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-221fbf90-e134-438a-8224-6a77f88a8997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955e7e0c32584aef8e2bc7eacb209e47'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:15.327694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cdbaf-f1b1-4ba7-903f-b03f9f267c02 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.330408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1346/2710] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:15 2022] DELETE /identity/v3/users/955e7e0c32584aef8e2bc7eacb209e47 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:15.334758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd74ae-8100-496d-893f-95f5a1b6fa7a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.335039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd74ae-8100-496d-893f-95f5a1b6fa7a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.335393 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd74ae-8100-496d-893f-95f5a1b6fa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.335952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.336550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.336829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.337099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.337714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.339639 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.355050 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c5cd74ae-8100-496d-893f-95f5a1b6fa7a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:15.356267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c5cd74ae-8100-496d-893f-95f5a1b6fa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:15.360777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1365/2711] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:15 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:15.364618 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.366439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:15.378313 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4add9a4-8e36-46c6-b6a1-10492c254fff admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.402563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:15.424271 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1347/2712] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:15.436216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd74ae-8100-496d-893f-95f5a1b6fa7a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.438733 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c5cd74ae-8100-496d-893f-95f5a1b6fa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:15.441861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb54c8-eae8-4ca3-a8e5-f677545c29c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.442830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb54c8-eae8-4ca3-a8e5-f677545c29c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.443278 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb54c8-eae8-4ca3-a8e5-f677545c29c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.443685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb54c8-eae8-4ca3-a8e5-f677545c29c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.444634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb54c8-eae8-4ca3-a8e5-f677545c29c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.446330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb54c8-eae8-4ca3-a8e5-f677545c29c4 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.457774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1366/2713] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:15.461957 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb54c8-eae8-4ca3-a8e5-f677545c29c4 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.471468 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb54c8-eae8-4ca3-a8e5-f677545c29c4 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.476146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c2ac8-63a8-46cc-bddc-6b0e7b2cf256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.476771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c2ac8-63a8-46cc-bddc-6b0e7b2cf256 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.477056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c2ac8-63a8-46cc-bddc-6b0e7b2cf256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.477335 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c2ac8-63a8-46cc-bddc-6b0e7b2cf256 admin admin] PATH_INFO: `/v3/projects/65cf41d57c37473bb3e7ca302a709f8c/users/d3bab15101d543b3bd39953f08457747/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.492135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c2ac8-63a8-46cc-bddc-6b0e7b2cf256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cf41d57c37473bb3e7ca302a709f8c, user_id=d3bab15101d543b3bd39953f08457747, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.494996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c2ac8-63a8-46cc-bddc-6b0e7b2cf256 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.496705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd74ae-8100-496d-893f-95f5a1b6fa7a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.501777 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964170c-4edd-445b-9315-25121590f240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.502539 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964170c-4edd-445b-9315-25121590f240 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.502822 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964170c-4edd-445b-9315-25121590f240 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.503099 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964170c-4edd-445b-9315-25121590f240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.508565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1367/2714] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:15 2022] PUT /identity/v3/projects/65cf41d57c37473bb3e7ca302a709f8c/users/d3bab15101d543b3bd39953f08457747/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:15.512328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c2ac8-63a8-46cc-bddc-6b0e7b2cf256 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.512905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964170c-4edd-445b-9315-25121590f240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.514362 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964170c-4edd-445b-9315-25121590f240 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.525103 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1348/2715] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:15.574860 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c2ac8-63a8-46cc-bddc-6b0e7b2cf256 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.580694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924526d-fc4e-466d-9b72-6aa6113ebaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.581300 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924526d-fc4e-466d-9b72-6aa6113ebaef admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.581591 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924526d-fc4e-466d-9b72-6aa6113ebaef admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.581897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924526d-fc4e-466d-9b72-6aa6113ebaef admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.582573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924526d-fc4e-466d-9b72-6aa6113ebaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.584159 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924526d-fc4e-466d-9b72-6aa6113ebaef admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.590166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:15.600128 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1368/2716] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:15.601533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964170c-4edd-445b-9315-25121590f240 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.612654 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964170c-4edd-445b-9315-25121590f240 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.617688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.618368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.618648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.618922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] PATH_INFO: `/v3/projects/65cf41d57c37473bb3e7ca302a709f8c/users/d3bab15101d543b3bd39953f08457747/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.620821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cf41d57c37473bb3e7ca302a709f8c, user_id=d3bab15101d543b3bd39953f08457747, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.623562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.635552 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1349/2717] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:15 2022] PUT /identity/v3/projects/65cf41d57c37473bb3e7ca302a709f8c/users/d3bab15101d543b3bd39953f08457747/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:15.646140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479ce6-39f3-4fb3-b6fc-50d8fe5f4dd5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.646524 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479ce6-39f3-4fb3-b6fc-50d8fe5f4dd5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.646984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479ce6-39f3-4fb3-b6fc-50d8fe5f4dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.678744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-93479ce6-39f3-4fb3-b6fc-50d8fe5f4dd5 None None] MFA Rules not processed for user `d3bab15101d543b3bd39953f08457747`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:15.679960 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-93479ce6-39f3-4fb3-b6fc-50d8fe5f4dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:15.755822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1369/2718] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:15.767242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.769601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:15.827046 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479ce6-39f3-4fb3-b6fc-50d8fe5f4dd5 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:15.829266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-93479ce6-39f3-4fb3-b6fc-50d8fe5f4dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:15.838306 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae725286-4d18-4766-87fd-d97bff9e00be admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.842267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e0ab0-78f1-4786-88af-a0c53497658a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.842881 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e0ab0-78f1-4786-88af-a0c53497658a service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.843164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e0ab0-78f1-4786-88af-a0c53497658a service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.843444 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e0ab0-78f1-4786-88af-a0c53497658a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.858787 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e0ab0-78f1-4786-88af-a0c53497658a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.860273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e0ab0-78f1-4786-88af-a0c53497658a service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.871371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1350/2719] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:15.911423 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479ce6-39f3-4fb3-b6fc-50d8fe5f4dd5 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:15.916039 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:15.916649 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:15.916931 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:15.917203 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] PATH_INFO: `/v3/projects/936ebcebb19841eab02a4e3b68c79fb8` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:15.918438 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936ebcebb19841eab02a4e3b68c79fb8)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:15.923724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:15.968950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936ebcebb19841eab02a4e3b68c79fb8', 'request_id': 'req-0e2e84da-c2aa-4bdc-af34-2d1851740985'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:15.975281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936ebcebb19841eab02a4e3b68c79fb8', 'request_id': 'req-0e2e84da-c2aa-4bdc-af34-2d1851740985'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:15.981859 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936ebcebb19841eab02a4e3b68c79fb8', 'request_id': 'req-0e2e84da-c2aa-4bdc-af34-2d1851740985'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.001161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] The token cache is being invalidate because project 936ebcebb19841eab02a4e3b68c79fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:16.001459 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.002134 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.003634 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1370/2720] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:15 2022] DELETE /identity/v3/projects/936ebcebb19841eab02a4e3b68c79fb8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:16.007751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e0ab0-78f1-4786-88af-a0c53497658a service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:16.020633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e0ab0-78f1-4786-88af-a0c53497658a service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:16.082588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:16.083218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.083502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.083771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] PATH_INFO: `/v3/users/536cfb975ad24a03aad8d3c0c33f5635` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.084896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=536cfb975ad24a03aad8d3c0c33f5635)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:16.086838 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:16.110759 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:16.149267 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536cfb975ad24a03aad8d3c0c33f5635'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.163622 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536cfb975ad24a03aad8d3c0c33f5635'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.164490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536cfb975ad24a03aad8d3c0c33f5635'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.173317 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536cfb975ad24a03aad8d3c0c33f5635'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.203419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536cfb975ad24a03aad8d3c0c33f5635'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.209745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1351/2721] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:16 2022] DELETE /identity/v3/users/536cfb975ad24a03aad8d3c0c33f5635 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:16.264760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:16.266540 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.277460 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:16.279065 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.292434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:16.347566 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e84da-c2aa-4bdc-af34-2d1851740985 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:16.361737 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3b05-f22e-42a8-bd37-3d06a7ed9c9b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:16.370849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:16.371503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.371783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.372054 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] PATH_INFO: `/v3/users/49fc5c312fab44358d6fdd3e20dff94b` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.373336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fc5c312fab44358d6fdd3e20dff94b)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:16.376452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:16.407834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:16.408485 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.408810 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.409147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.410971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.435185 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fc5c312fab44358d6fdd3e20dff94b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.445568 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fc5c312fab44358d6fdd3e20dff94b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.447008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fc5c312fab44358d6fdd3e20dff94b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.457977 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fc5c312fab44358d6fdd3e20dff94b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.476260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-33bfd47e-dc61-4b70-b0c0-05e070db58d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fc5c312fab44358d6fdd3e20dff94b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.482896 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1352/2722] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:16 2022] DELETE /identity/v3/users/49fc5c312fab44358d6fdd3e20dff94b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:16.487225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd9782-5d2d-4849-bdf9-84b6871c5bd5 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.487698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd9782-5d2d-4849-bdf9-84b6871c5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.488170 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd9782-5d2d-4849-bdf9-84b6871c5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.488728 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:16.490274 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:16.501515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1371/2723] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:16.511092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-77cd9782-5d2d-4849-bdf9-84b6871c5bd5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:16.512558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-77cd9782-5d2d-4849-bdf9-84b6871c5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.524915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:16.526642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.537157 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:16.543753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc630711-539b-4b59-b056-ba0077a3c088 service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:16.602344 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1353/2724] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:16.612329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd9782-5d2d-4849-bdf9-84b6871c5bd5 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:16.613701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-77cd9782-5d2d-4849-bdf9-84b6871c5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.619638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:16.620496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.621062 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.621519 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] PATH_INFO: `/v3/projects/165df5440cfc4a52ac7e98e95ff96100` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.622688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=165df5440cfc4a52ac7e98e95ff96100)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:16.624588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:16.660984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:16.685524 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd9782-5d2d-4849-bdf9-84b6871c5bd5 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:16.690477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165df5440cfc4a52ac7e98e95ff96100', 'request_id': 'req-42024582-7634-4f7a-a56f-70950c6f2d93'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.699251 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165df5440cfc4a52ac7e98e95ff96100', 'request_id': 'req-42024582-7634-4f7a-a56f-70950c6f2d93'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.707788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165df5440cfc4a52ac7e98e95ff96100', 'request_id': 'req-42024582-7634-4f7a-a56f-70950c6f2d93'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.723374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] The token cache is being invalidate because project 165df5440cfc4a52ac7e98e95ff96100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:16.723668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.724328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-42024582-7634-4f7a-a56f-70950c6f2d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:16.726103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1372/2725] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:16 2022] DELETE /identity/v3/projects/165df5440cfc4a52ac7e98e95ff96100 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:16.730682 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a9db0-91c2-4d56-a9d2-f7e1b7fafcd5 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.731082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a9db0-91c2-4d56-a9d2-f7e1b7fafcd5 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.731492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a9db0-91c2-4d56-a9d2-f7e1b7fafcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.752207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-2c2a9db0-91c2-4d56-a9d2-f7e1b7fafcd5 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:16.753518 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-2c2a9db0-91c2-4d56-a9d2-f7e1b7fafcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.755089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:16.755753 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.755988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.756238 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.758003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.839246 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:16.840936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:16.853685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1373/2726] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:16.853685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703fdf2-9698-4811-a0c5-1089c85e2208 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.853685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703fdf2-9698-4811-a0c5-1089c85e2208 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.853685 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703fdf2-9698-4811-a0c5-1089c85e2208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.864027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1354/2727] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:16.875812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-7703fdf2-9698-4811-a0c5-1089c85e2208 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:16.877034 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7703fdf2-9698-4811-a0c5-1089c85e2208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:16.885597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1374/2728] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:16.889766 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:16.900408 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d061bf-6e9b-4414-baa7-f7a6e39c84e7 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:16.905434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:16.906034 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.906961 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.907237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.907884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:16.909751 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:16.909877 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:16.923261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1355/2729] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:38:16.927611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703fdf2-9698-4811-a0c5-1089c85e2208 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:16.938793 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703fdf2-9698-4811-a0c5-1089c85e2208 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:16.945911 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4112a-0ebd-401e-9672-b0924cd81053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:16.946554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4112a-0ebd-401e-9672-b0924cd81053 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:16.946816 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4112a-0ebd-401e-9672-b0924cd81053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:16.947082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4112a-0ebd-401e-9672-b0924cd81053 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:16.947702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4112a-0ebd-401e-9672-b0924cd81053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:16.950113 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4112a-0ebd-401e-9672-b0924cd81053 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:16.983739 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1375/2730] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:16 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:16.985532 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:16.995810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5863c-23e0-47e8-9b07-3f7a53bdc22a admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.003712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:17.056934 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e33fef-7757-45fb-82dc-0eeed1403819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.057533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33fef-7757-45fb-82dc-0eeed1403819 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.057810 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33fef-7757-45fb-82dc-0eeed1403819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.058093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33fef-7757-45fb-82dc-0eeed1403819 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.058723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e33fef-7757-45fb-82dc-0eeed1403819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.060628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e33fef-7757-45fb-82dc-0eeed1403819 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.082649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1356/2731] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:16 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:17.086718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4112a-0ebd-401e-9672-b0924cd81053 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.097830 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4112a-0ebd-401e-9672-b0924cd81053 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.103283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.103996 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.104284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.104558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.105225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.106849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.117106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1376/2732] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:17.121376 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e33fef-7757-45fb-82dc-0eeed1403819 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.133448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e33fef-7757-45fb-82dc-0eeed1403819 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.138853 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721aa65e-85e8-42c3-a258-6cf81c8deb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.139668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aa65e-85e8-42c3-a258-6cf81c8deb92 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.139975 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aa65e-85e8-42c3-a258-6cf81c8deb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.140318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aa65e-85e8-42c3-a258-6cf81c8deb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.141192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721aa65e-85e8-42c3-a258-6cf81c8deb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.143212 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721aa65e-85e8-42c3-a258-6cf81c8deb92 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.149713 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.151469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:17.160243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1357/2733] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:17.162005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721aa65e-85e8-42c3-a258-6cf81c8deb92 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.164840 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58383f-ec10-4ddc-b7f4-59849a4c9d79 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.169733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.170422 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.170708 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.170989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] PATH_INFO: `/v3/projects/3e7ac236292f423d8eb5eb7b452c2e55` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.172677 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7ac236292f423d8eb5eb7b452c2e55)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.174375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721aa65e-85e8-42c3-a258-6cf81c8deb92 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.174617 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.180982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.181652 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.181904 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.182319 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] PATH_INFO: `/v3/projects/0cee5749bb4d4bfa8cd21a4dc8b91548/users/80780784f30e484692d2a13af499b21d/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.197432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cee5749bb4d4bfa8cd21a4dc8b91548, user_id=80780784f30e484692d2a13af499b21d, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.200117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.214090 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1358/2734] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:17 2022] PUT /identity/v3/projects/0cee5749bb4d4bfa8cd21a4dc8b91548/users/80780784f30e484692d2a13af499b21d/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:17.228197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7ac236292f423d8eb5eb7b452c2e55', 'request_id': 'req-ab872533-7dfa-4e68-89b7-32dad7b278b1'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.234555 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7ac236292f423d8eb5eb7b452c2e55', 'request_id': 'req-ab872533-7dfa-4e68-89b7-32dad7b278b1'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.243746 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7ac236292f423d8eb5eb7b452c2e55', 'request_id': 'req-ab872533-7dfa-4e68-89b7-32dad7b278b1'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.248738 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:17.260550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] The token cache is being invalidate because project 3e7ac236292f423d8eb5eb7b452c2e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:17.261064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.262154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-ab872533-7dfa-4e68-89b7-32dad7b278b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.263723 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1377/2735] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:17 2022] DELETE /identity/v3/projects/3e7ac236292f423d8eb5eb7b452c2e55 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:17.268835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.270752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:17.283073 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6b57-167d-4313-b6cf-5278a7b54d3a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.283355 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6b57-167d-4313-b6cf-5278a7b54d3a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.283626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6b57-167d-4313-b6cf-5278a7b54d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.320174 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a5ed6b57-167d-4313-b6cf-5278a7b54d3a None None] MFA Rules not processed for user `80780784f30e484692d2a13af499b21d`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:17.321395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a5ed6b57-167d-4313-b6cf-5278a7b54d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:17.337710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840776ea-f5b7-4da3-b7f0-07d267f4a28b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.386137 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1378/2736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:17.390530 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed6b57-167d-4313-b6cf-5278a7b54d3a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.391799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a5ed6b57-167d-4313-b6cf-5278a7b54d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:17.394281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.394915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.395199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.395476 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] PATH_INFO: `/v3/users/d3bab15101d543b3bd39953f08457747` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.396597 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bab15101d543b3bd39953f08457747)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.398547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.404781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed6b57-167d-4313-b6cf-5278a7b54d3a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.409694 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbc40-50b4-459d-b4ea-5b9c7d43c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.410311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbc40-50b4-459d-b4ea-5b9c7d43c6aa admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.410588 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbc40-50b4-459d-b4ea-5b9c7d43c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.410856 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbc40-50b4-459d-b4ea-5b9c7d43c6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.411465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fbc40-50b4-459d-b4ea-5b9c7d43c6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.413057 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:17.413324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fbc40-50b4-459d-b4ea-5b9c7d43c6aa admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.450170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1379/2737] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:17 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:17.452232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbc40-50b4-459d-b4ea-5b9c7d43c6aa admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.453700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bab15101d543b3bd39953f08457747'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.462666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bab15101d543b3bd39953f08457747'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.463373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bab15101d543b3bd39953f08457747'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.470649 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bab15101d543b3bd39953f08457747'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.482492 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bab15101d543b3bd39953f08457747'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.489339 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1359/2738] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:17 2022] DELETE /identity/v3/users/d3bab15101d543b3bd39953f08457747 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:17.518549 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbc40-50b4-459d-b4ea-5b9c7d43c6aa admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.577988 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7bff8-e974-415c-b576-ae730df9f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.578646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7bff8-e974-415c-b576-ae730df9f498 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.578933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7bff8-e974-415c-b576-ae730df9f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.579213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7bff8-e974-415c-b576-ae730df9f498 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.579850 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7bff8-e974-415c-b576-ae730df9f498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.581764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7bff8-e974-415c-b576-ae730df9f498 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.599624 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:17.609197 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.611156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:17.612768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1380/2739] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:17 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:17.624511 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad26cc-3dcd-4093-91e9-520c04182556 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.629501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017c1d9-20e9-4d24-afbb-f1aded9b235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.630134 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017c1d9-20e9-4d24-afbb-f1aded9b235d admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.630425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017c1d9-20e9-4d24-afbb-f1aded9b235d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.630705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017c1d9-20e9-4d24-afbb-f1aded9b235d admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.631356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017c1d9-20e9-4d24-afbb-f1aded9b235d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.633129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017c1d9-20e9-4d24-afbb-f1aded9b235d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.646242 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1360/2740] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:17.648458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7bff8-e974-415c-b576-ae730df9f498 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.660360 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7bff8-e974-415c-b576-ae730df9f498 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.665202 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237c147-a826-4096-804c-70b3ebf7de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.665781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c147-a826-4096-804c-70b3ebf7de3b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.666091 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c147-a826-4096-804c-70b3ebf7de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.666371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c147-a826-4096-804c-70b3ebf7de3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.667014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237c147-a826-4096-804c-70b3ebf7de3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.668590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237c147-a826-4096-804c-70b3ebf7de3b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.678806 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1381/2741] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:17.683035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017c1d9-20e9-4d24-afbb-f1aded9b235d admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.693573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017c1d9-20e9-4d24-afbb-f1aded9b235d admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.698401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.699118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.699464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.699813 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] PATH_INFO: `/v3/projects/b74468265fe449fcb158fdb8003bde7c/users/c17871a8f3474c95a7e79a4ac01ce890/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.715682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74468265fe449fcb158fdb8003bde7c, user_id=c17871a8f3474c95a7e79a4ac01ce890, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.718490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.732755 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1361/2742] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:17 2022] PUT /identity/v3/projects/b74468265fe449fcb158fdb8003bde7c/users/c17871a8f3474c95a7e79a4ac01ce890/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:17.743230 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd82f-57a5-45f8-a52f-e696f21e4db2 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.743520 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd82f-57a5-45f8-a52f-e696f21e4db2 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.743796 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd82f-57a5-45f8-a52f-e696f21e4db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.778281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d8bbd82f-57a5-45f8-a52f-e696f21e4db2 None None] MFA Rules not processed for user `c17871a8f3474c95a7e79a4ac01ce890`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:17.780086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d8bbd82f-57a5-45f8-a52f-e696f21e4db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:17.793061 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.795363 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:17.859298 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1382/2743] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:17.865250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbd82f-57a5-45f8-a52f-e696f21e4db2 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.876945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa05432-fc7b-4cdf-bc80-9a1052ff7643 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.879101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbd82f-57a5-45f8-a52f-e696f21e4db2 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:17.883059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.883910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.884292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.884408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d5bc-5185-4885-a253-1f44922c8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:17.884825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] PATH_INFO: `/v3/projects/65cf41d57c37473bb3e7ca302a709f8c` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.885012 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d5bc-5185-4885-a253-1f44922c8ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.885294 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d5bc-5185-4885-a253-1f44922c8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.885730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d5bc-5185-4885-a253-1f44922c8ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:17.886397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534d5bc-5185-4885-a253-1f44922c8ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.886660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cf41d57c37473bb3e7ca302a709f8c)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:17.888330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534d5bc-5185-4885-a253-1f44922c8ae5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.889278 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:17.922303 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1383/2744] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:17 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:17.926597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d5bc-5185-4885-a253-1f44922c8ae5 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:17.948515 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cf41d57c37473bb3e7ca302a709f8c', 'request_id': 'req-b50a39be-5853-4fc6-9ca8-311321582649'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.954760 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cf41d57c37473bb3e7ca302a709f8c', 'request_id': 'req-b50a39be-5853-4fc6-9ca8-311321582649'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.956477 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:17.964910 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cf41d57c37473bb3e7ca302a709f8c', 'request_id': 'req-b50a39be-5853-4fc6-9ca8-311321582649'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.981504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] The token cache is being invalidate because project 65cf41d57c37473bb3e7ca302a709f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:17.981815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.982469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-b50a39be-5853-4fc6-9ca8-311321582649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:17.984240 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1362/2745] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:17 2022] DELETE /identity/v3/projects/65cf41d57c37473bb3e7ca302a709f8c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:17.989462 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dcf9e-88f4-43c1-a1d2-3f356d6f5890 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:17.989848 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dcf9e-88f4-43c1-a1d2-3f356d6f5890 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:17.990161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dcf9e-88f4-43c1-a1d2-3f356d6f5890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.001802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d5bc-5185-4885-a253-1f44922c8ae5 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.015227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-654dcf9e-88f4-43c1-a1d2-3f356d6f5890 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:18.017005 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-654dcf9e-88f4-43c1-a1d2-3f356d6f5890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.099963 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.100855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.101338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.101614 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.102334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.103628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1363/2746] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:18.104182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.114945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4305a-255e-4b89-8991-1ec1007bb92e None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.115582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4305a-255e-4b89-8991-1ec1007bb92e None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.116236 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4305a-255e-4b89-8991-1ec1007bb92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.117915 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:18.138877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1384/2747] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:17 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:18.145751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.148418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.153927 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-dac4305a-255e-4b89-8991-1ec1007bb92e None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:18.155692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dac4305a-255e-4b89-8991-1ec1007bb92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.161927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851becc-4e56-40b5-af57-6a3de98020b1 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.167172 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1364/2748] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:18.169779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc9516-1be2-4a58-b352-bc90d69ee2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.169956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4305a-255e-4b89-8991-1ec1007bb92e None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.170646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc9516-1be2-4a58-b352-bc90d69ee2bd admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.170805 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc9516-1be2-4a58-b352-bc90d69ee2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.171067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc9516-1be2-4a58-b352-bc90d69ee2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.171698 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc9516-1be2-4a58-b352-bc90d69ee2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.173801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc9516-1be2-4a58-b352-bc90d69ee2bd admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.180625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4305a-255e-4b89-8991-1ec1007bb92e None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.186561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.187260 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.188440 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.188589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.189533 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:18.189662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.191570 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.193502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1385/2749] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:18.194918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc9516-1be2-4a58-b352-bc90d69ee2bd admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.204625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1365/2750] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:38:18.205613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc9516-1be2-4a58-b352-bc90d69ee2bd admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.208876 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.210997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578709cd-c268-41b6-a1af-517979c39735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.211733 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578709cd-c268-41b6-a1af-517979c39735 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.212352 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578709cd-c268-41b6-a1af-517979c39735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.212494 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578709cd-c268-41b6-a1af-517979c39735 admin admin] PATH_INFO: `/v3/projects/9aa5c08e63864d388cd8c1559029e61e/users/75ca426cae79440ab03d1ed6888681fc/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.228560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578709cd-c268-41b6-a1af-517979c39735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa5c08e63864d388cd8c1559029e61e, user_id=75ca426cae79440ab03d1ed6888681fc, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.230610 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e4921-947c-4edb-8a65-dade363803ef admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.231324 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578709cd-c268-41b6-a1af-517979c39735 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.236506 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148454f-00fa-47af-9277-eae591b297fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.236769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148454f-00fa-47af-9277-eae591b297fb admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.237093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148454f-00fa-47af-9277-eae591b297fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.237352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148454f-00fa-47af-9277-eae591b297fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.237978 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148454f-00fa-47af-9277-eae591b297fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.239966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148454f-00fa-47af-9277-eae591b297fb admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.247409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1386/2751] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:18 2022] PUT /identity/v3/projects/9aa5c08e63864d388cd8c1559029e61e/users/75ca426cae79440ab03d1ed6888681fc/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:18.251902 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578709cd-c268-41b6-a1af-517979c39735 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.270106 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1366/2752] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:18 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:18.274827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148454f-00fa-47af-9277-eae591b297fb admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.317950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578709cd-c268-41b6-a1af-517979c39735 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.340805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148454f-00fa-47af-9277-eae591b297fb admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.345830 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c27b-0c9f-4167-8754-a444aa35c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.346465 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c27b-0c9f-4167-8754-a444aa35c6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.346747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c27b-0c9f-4167-8754-a444aa35c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.347020 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c27b-0c9f-4167-8754-a444aa35c6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.347682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1c27b-0c9f-4167-8754-a444aa35c6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.349559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1c27b-0c9f-4167-8754-a444aa35c6b4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.373828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1367/2753] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:18 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:18.377856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c27b-0c9f-4167-8754-a444aa35c6b4 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.382646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3cce9-8fb6-4528-8a56-2c33bdbfccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.383393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cce9-8fb6-4528-8a56-2c33bdbfccc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.383691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cce9-8fb6-4528-8a56-2c33bdbfccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.383976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cce9-8fb6-4528-8a56-2c33bdbfccc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.384622 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3cce9-8fb6-4528-8a56-2c33bdbfccc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.386250 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3cce9-8fb6-4528-8a56-2c33bdbfccc0 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.388104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c27b-0c9f-4167-8754-a444aa35c6b4 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.393565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab4100-4e52-4705-aea2-6109923033f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.394107 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4100-4e52-4705-aea2-6109923033f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.394389 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4100-4e52-4705-aea2-6109923033f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.394660 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4100-4e52-4705-aea2-6109923033f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.395302 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab4100-4e52-4705-aea2-6109923033f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.396869 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab4100-4e52-4705-aea2-6109923033f7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.397487 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1387/2754] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:18.401545 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3cce9-8fb6-4528-8a56-2c33bdbfccc0 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.409863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1368/2755] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:18.411292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab4100-4e52-4705-aea2-6109923033f7 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.411743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3cce9-8fb6-4528-8a56-2c33bdbfccc0 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.417132 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd96cf1-6d29-4426-a56b-0f77663e7534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.417812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd96cf1-6d29-4426-a56b-0f77663e7534 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.418154 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd96cf1-6d29-4426-a56b-0f77663e7534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.418461 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd96cf1-6d29-4426-a56b-0f77663e7534 admin admin] PATH_INFO: `/v3/projects/9aa5c08e63864d388cd8c1559029e61e/users/75ca426cae79440ab03d1ed6888681fc/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.420347 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd96cf1-6d29-4426-a56b-0f77663e7534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa5c08e63864d388cd8c1559029e61e, user_id=75ca426cae79440ab03d1ed6888681fc, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.421898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab4100-4e52-4705-aea2-6109923033f7 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.423023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd96cf1-6d29-4426-a56b-0f77663e7534 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.426872 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352bed-421d-4b69-9af9-36f4ec1138a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.427452 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352bed-421d-4b69-9af9-36f4ec1138a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.427856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352bed-421d-4b69-9af9-36f4ec1138a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.428186 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352bed-421d-4b69-9af9-36f4ec1138a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.428828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04352bed-421d-4b69-9af9-36f4ec1138a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.430806 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04352bed-421d-4b69-9af9-36f4ec1138a4 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.435458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1388/2756] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:18 2022] PUT /identity/v3/projects/9aa5c08e63864d388cd8c1559029e61e/users/75ca426cae79440ab03d1ed6888681fc/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:18.445290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1369/2757] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:18.446228 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352bed-421d-4b69-9af9-36f4ec1138a4 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.446629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7c3b7-77f7-4ab2-aff6-63c4b8fbb497 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.447047 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7c3b7-77f7-4ab2-aff6-63c4b8fbb497 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.447245 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7c3b7-77f7-4ab2-aff6-63c4b8fbb497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.456744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352bed-421d-4b69-9af9-36f4ec1138a4 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.466481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:18.481512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f1f7c3b7-77f7-4ab2-aff6-63c4b8fbb497 None None] MFA Rules not processed for user `75ca426cae79440ab03d1ed6888681fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:18.482758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f1f7c3b7-77f7-4ab2-aff6-63c4b8fbb497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.520922 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e03081-affa-41d7-bb91-a100511ad942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.521808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e03081-affa-41d7-bb91-a100511ad942 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.522232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e03081-affa-41d7-bb91-a100511ad942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.522613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e03081-affa-41d7-bb91-a100511ad942 admin admin] PATH_INFO: `/v3/projects/610f905a50d9496cbc0b067edaf2067c/users/8003251c1d9a4ac1a9f2ff5bb2987daf/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.526101 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:18.539283 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e03081-affa-41d7-bb91-a100511ad942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=610f905a50d9496cbc0b067edaf2067c, user_id=8003251c1d9a4ac1a9f2ff5bb2987daf, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.542119 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e03081-affa-41d7-bb91-a100511ad942 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.555636 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1370/2758] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:18 2022] PUT /identity/v3/projects/610f905a50d9496cbc0b067edaf2067c/users/8003251c1d9a4ac1a9f2ff5bb2987daf/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:18.560555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b067a-cbd2-46b9-85df-6675af61cc8f None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.560836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b067a-cbd2-46b9-85df-6675af61cc8f None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.560990 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1389/2759] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:18.561398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b067a-cbd2-46b9-85df-6675af61cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.573261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7c3b7-77f7-4ab2-aff6-63c4b8fbb497 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.574650 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f1f7c3b7-77f7-4ab2-aff6-63c4b8fbb497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.580916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a44b067a-cbd2-46b9-85df-6675af61cc8f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:18.582173 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a44b067a-cbd2-46b9-85df-6675af61cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.636443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7c3b7-77f7-4ab2-aff6-63c4b8fbb497 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.644045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1371/2760] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:18.653696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b067a-cbd2-46b9-85df-6675af61cc8f None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.655071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a44b067a-cbd2-46b9-85df-6675af61cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.689215 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd111a6-4465-4200-90f8-c03545682c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.689927 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd111a6-4465-4200-90f8-c03545682c3c service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.690235 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd111a6-4465-4200-90f8-c03545682c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.690511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd111a6-4465-4200-90f8-c03545682c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.711544 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b067a-cbd2-46b9-85df-6675af61cc8f None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.716196 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.716878 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.717233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.717580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.727367 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.728799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.739399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1372/2761] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:18.762261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd111a6-4465-4200-90f8-c03545682c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.764112 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd111a6-4465-4200-90f8-c03545682c3c service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.775067 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1390/2762] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:18.817643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:18.819227 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.832916 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10ea67-894a-4243-a695-f0c519d25ab3 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:18.837788 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:18.838425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:18.838710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:18.838987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:18.841011 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:18.887866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:18.912879 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:18.914369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:18.927040 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1373/2763] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:19.715572 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07491d-6ddb-4833-8009-6eeadaa96f74 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:19.716110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07491d-6ddb-4833-8009-6eeadaa96f74 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:19.716346 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07491d-6ddb-4833-8009-6eeadaa96f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:19.747196 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9a07491d-6ddb-4833-8009-6eeadaa96f74 None None] MFA Rules not processed for user `8003251c1d9a4ac1a9f2ff5bb2987daf`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:19.748458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9a07491d-6ddb-4833-8009-6eeadaa96f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:19.778829 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:19.819809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1391/2764] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:19.831895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:19.841152 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cae0-6b85-4ca4-b4c2-6be6ae8a860a service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:19.845312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:19.845906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:19.846233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:19.846510 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:19.855331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:19.856786 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:19.867208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1374/2765] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:21.228998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631167f3-2571-4360-b85f-d656cae78d99 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:21.229512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631167f3-2571-4360-b85f-d656cae78d99 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:21.229711 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631167f3-2571-4360-b85f-d656cae78d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:21.249745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-631167f3-2571-4360-b85f-d656cae78d99 None None] MFA Rules not processed for user `8003251c1d9a4ac1a9f2ff5bb2987daf`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:21.251584 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-631167f3-2571-4360-b85f-d656cae78d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:21.258395 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1392/2766] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:21.536025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:21.537518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:21.554710 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a4c41-2ea2-46b2-8996-c3df65976c89 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:21.559498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:21.560213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:21.560495 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:21.560771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] PATH_INFO: `/v3/users/b1dd3bf7234c419d80efe4d1828e996b` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:21.562003 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1dd3bf7234c419d80efe4d1828e996b)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:21.564069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:21.623381 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1dd3bf7234c419d80efe4d1828e996b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:21.631126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1dd3bf7234c419d80efe4d1828e996b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:21.631969 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1dd3bf7234c419d80efe4d1828e996b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:21.639293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1dd3bf7234c419d80efe4d1828e996b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:21.654669 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1dd3bf7234c419d80efe4d1828e996b'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:21.661752 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1375/2767] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:21 2022] DELETE /identity/v3/users/b1dd3bf7234c419d80efe4d1828e996b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:21.666178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d1c8-fd27-407b-861c-404175564d3c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:21.666477 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d1c8-fd27-407b-861c-404175564d3c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:21.666811 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d1c8-fd27-407b-861c-404175564d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:21.686580 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-0df5d1c8-fd27-407b-861c-404175564d3c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:21.687667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0df5d1c8-fd27-407b-861c-404175564d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:21.750625 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1393/2768] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:21.761001 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:21.762536 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:21.852100 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2db75-8159-4c52-ba9b-beea5f6608d2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:21.861455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f82c7-c07d-46fa-ba69-3dfa234dab6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:21.862162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f82c7-c07d-46fa-ba69-3dfa234dab6a service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:21.862448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f82c7-c07d-46fa-ba69-3dfa234dab6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:21.862726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f82c7-c07d-46fa-ba69-3dfa234dab6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:21.876371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f82c7-c07d-46fa-ba69-3dfa234dab6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:21.878114 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f82c7-c07d-46fa-ba69-3dfa234dab6a service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:21.894243 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1376/2769] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:21.916166 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d1c8-fd27-407b-861c-404175564d3c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:21.917940 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0df5d1c8-fd27-407b-861c-404175564d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:21.932140 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d1c8-fd27-407b-861c-404175564d3c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:21.937344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:21.937923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:21.938478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:21.938702 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] PATH_INFO: `/v3/users/80780784f30e484692d2a13af499b21d` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:21.939862 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=80780784f30e484692d2a13af499b21d)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:21.941659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:21.995923 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80780784f30e484692d2a13af499b21d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.004956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80780784f30e484692d2a13af499b21d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.005691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80780784f30e484692d2a13af499b21d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.006323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80780784f30e484692d2a13af499b21d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.022375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80780784f30e484692d2a13af499b21d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.037206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1394/2770] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:21 2022] DELETE /identity/v3/users/80780784f30e484692d2a13af499b21d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:22.042650 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb45e3-d4b9-4f6c-856c-065f9ab4003b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:22.043148 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb45e3-d4b9-4f6c-856c-065f9ab4003b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:22.043429 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb45e3-d4b9-4f6c-856c-065f9ab4003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:22.065187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8efb45e3-d4b9-4f6c-856c-065f9ab4003b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:22.075358 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8efb45e3-d4b9-4f6c-856c-065f9ab4003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:22.119215 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:22.160574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1377/2771] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:22.173984 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:22.177393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:22.220501 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb45e3-d4b9-4f6c-856c-065f9ab4003b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:22.222129 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8efb45e3-d4b9-4f6c-856c-065f9ab4003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:22.236707 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:22.244023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb45e3-d4b9-4f6c-856c-065f9ab4003b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:22.253051 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:22.255988 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:22.256284 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:22.256800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] PATH_INFO: `/v3/projects/801bf19b49674f8394d8fd154537c4ed` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:22.258949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801bf19b49674f8394d8fd154537c4ed)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:22.260270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221fc83-c432-4694-8728-2208ddb7cb6d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:22.261337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:22.266743 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9e506-09f5-48c1-9561-3dfa047321cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:22.267358 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9e506-09f5-48c1-9561-3dfa047321cc service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:22.268209 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9e506-09f5-48c1-9561-3dfa047321cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:22.268490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9e506-09f5-48c1-9561-3dfa047321cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:22.278651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9e506-09f5-48c1-9561-3dfa047321cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:22.280640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9e506-09f5-48c1-9561-3dfa047321cc service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:22.291225 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1395/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:22.322357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801bf19b49674f8394d8fd154537c4ed', 'request_id': 'req-8c6153d6-61ad-44b2-8fe7-c05907306ed2'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.329984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801bf19b49674f8394d8fd154537c4ed', 'request_id': 'req-8c6153d6-61ad-44b2-8fe7-c05907306ed2'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.336984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801bf19b49674f8394d8fd154537c4ed', 'request_id': 'req-8c6153d6-61ad-44b2-8fe7-c05907306ed2'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.349955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] The token cache is being invalidate because project 801bf19b49674f8394d8fd154537c4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:22.350404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.351169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.352763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1378/2773] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:22 2022] DELETE /identity/v3/projects/801bf19b49674f8394d8fd154537c4ed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:22.356921 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9e506-09f5-48c1-9561-3dfa047321cc service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:22.368751 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9e506-09f5-48c1-9561-3dfa047321cc service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:22.439291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:22.439928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:22.440210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:22.440488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] PATH_INFO: `/v3/users/64cf7fc1d3b14a26b0c27de0206ddf15` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:22.441654 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64cf7fc1d3b14a26b0c27de0206ddf15)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:22.443681 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:22.500279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64cf7fc1d3b14a26b0c27de0206ddf15'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.509760 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64cf7fc1d3b14a26b0c27de0206ddf15'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.510567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64cf7fc1d3b14a26b0c27de0206ddf15'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.511375 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64cf7fc1d3b14a26b0c27de0206ddf15'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.525948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64cf7fc1d3b14a26b0c27de0206ddf15'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.541383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1396/2774] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:22 2022] DELETE /identity/v3/users/64cf7fc1d3b14a26b0c27de0206ddf15 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:22.607386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:22.608953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:22.625768 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6153d6-61ad-44b2-8fe7-c05907306ed2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:22.694705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:22.695340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:22.695618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:22.695889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] PATH_INFO: `/v3/projects/0cee5749bb4d4bfa8cd21a4dc8b91548` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:22.697017 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cee5749bb4d4bfa8cd21a4dc8b91548)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:22.698982 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:22.748971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cee5749bb4d4bfa8cd21a4dc8b91548', 'request_id': 'req-72ea731d-670d-4a0a-b7e8-9e46e7b80959'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.754971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cee5749bb4d4bfa8cd21a4dc8b91548', 'request_id': 'req-72ea731d-670d-4a0a-b7e8-9e46e7b80959'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.761138 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cee5749bb4d4bfa8cd21a4dc8b91548', 'request_id': 'req-72ea731d-670d-4a0a-b7e8-9e46e7b80959'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.763761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:22.777167 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] The token cache is being invalidate because project 0cee5749bb4d4bfa8cd21a4dc8b91548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:22.777459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.778085 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.779696 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1379/2775] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:22 2022] DELETE /identity/v3/projects/0cee5749bb4d4bfa8cd21a4dc8b91548 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:22.784204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:22.785603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:22.803102 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a852-8f6b-47e4-a678-4b2058a18df7 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:22.865144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:22.871624 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:22.874677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:22.884041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:22.884691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:22.884971 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:22.885241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] PATH_INFO: `/v3/users/c17871a8f3474c95a7e79a4ac01ce890` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:22.886430 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17871a8f3474c95a7e79a4ac01ce890)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:22.888526 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:22.907991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea731d-670d-4a0a-b7e8-9e46e7b80959 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:22.915213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:22.915863 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:22.916143 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:22.916417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] PATH_INFO: `/v3/projects/222d70ab260b48f9b2c7572db8a61a3c` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:22.917611 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=222d70ab260b48f9b2c7572db8a61a3c)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:22.919714 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:22.982356 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222d70ab260b48f9b2c7572db8a61a3c', 'request_id': 'req-5c2955f4-d699-48cd-b340-742583dda27a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.982564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17871a8f3474c95a7e79a4ac01ce890'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.995511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17871a8f3474c95a7e79a4ac01ce890'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.996320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17871a8f3474c95a7e79a4ac01ce890'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:22.997061 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17871a8f3474c95a7e79a4ac01ce890'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.006518 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222d70ab260b48f9b2c7572db8a61a3c', 'request_id': 'req-5c2955f4-d699-48cd-b340-742583dda27a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.014765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-823f3bcd-aaa4-459d-a2d6-43dab982dd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17871a8f3474c95a7e79a4ac01ce890'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.014944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222d70ab260b48f9b2c7572db8a61a3c', 'request_id': 'req-5c2955f4-d699-48cd-b340-742583dda27a'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.047809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1397/2776] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:22 2022] DELETE /identity/v3/users/c17871a8f3474c95a7e79a4ac01ce890 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:23.048028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] The token cache is being invalidate because project 222d70ab260b48f9b2c7572db8a61a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:23.048028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.048318 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-5c2955f4-d699-48cd-b340-742583dda27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.049944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1380/2777] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:22 2022] DELETE /identity/v3/projects/222d70ab260b48f9b2c7572db8a61a3c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:23.056593 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d305dd-acd6-4393-af14-021717bafada None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.057198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d305dd-acd6-4393-af14-021717bafada None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.057753 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d305dd-acd6-4393-af14-021717bafada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.080017 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-14d305dd-acd6-4393-af14-021717bafada None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:23.081599 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-14d305dd-acd6-4393-af14-021717bafada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:23.175783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48880a-563a-4c1b-9915-6ea1499f9a6a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.176063 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48880a-563a-4c1b-9915-6ea1499f9a6a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.176350 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48880a-563a-4c1b-9915-6ea1499f9a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.178268 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1398/2778] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:23.199015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-cf48880a-563a-4c1b-9915-6ea1499f9a6a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:23.200387 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-cf48880a-563a-4c1b-9915-6ea1499f9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:23.209293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1381/2779] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:23.213969 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d305dd-acd6-4393-af14-021717bafada None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.224176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d305dd-acd6-4393-af14-021717bafada None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.232935 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.233536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.233821 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.234217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.234882 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:23.235255 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:23.236897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:23.251133 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1399/2780] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:38:23.255743 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48880a-563a-4c1b-9915-6ea1499f9a6a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.265219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48880a-563a-4c1b-9915-6ea1499f9a6a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.270631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.271561 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.272047 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.272541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.273396 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:23.275598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:23.310324 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1382/2781] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:23 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:23.314554 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.326353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a84e2-90b1-4aaf-b22b-40678c0238d9 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.406199 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.409200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:23.426550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586705d-9f59-4486-a4e3-e10c400e69ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.428294 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586705d-9f59-4486-a4e3-e10c400e69ce admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.428458 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586705d-9f59-4486-a4e3-e10c400e69ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.428932 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586705d-9f59-4486-a4e3-e10c400e69ce admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.431178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586705d-9f59-4486-a4e3-e10c400e69ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:23.436258 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586705d-9f59-4486-a4e3-e10c400e69ce admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:23.452337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:23.472467 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1400/2782] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:23 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:23.476116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586705d-9f59-4486-a4e3-e10c400e69ce admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.486560 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586705d-9f59-4486-a4e3-e10c400e69ce admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.491392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a3c8c-b9c9-420c-8148-2343317b5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.491997 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3c8c-b9c9-420c-8148-2343317b5d8e admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.492284 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3c8c-b9c9-420c-8148-2343317b5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.492564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3c8c-b9c9-420c-8148-2343317b5d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.493339 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a3c8c-b9c9-420c-8148-2343317b5d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:23.494836 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a3c8c-b9c9-420c-8148-2343317b5d8e admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:23.502559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc504-1f19-4235-b7aa-4e6fc23b25ff admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.508161 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1401/2783] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:23.512029 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a3c8c-b9c9-420c-8148-2343317b5d8e admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.512374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.513055 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.513343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.513626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] PATH_INFO: `/v3/projects/b74468265fe449fcb158fdb8003bde7c` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.514808 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74468265fe449fcb158fdb8003bde7c)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:23.516921 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:23.522998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a3c8c-b9c9-420c-8148-2343317b5d8e admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.527973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14703a1a-7d85-4acd-a4da-d3fb7deaccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.528563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14703a1a-7d85-4acd-a4da-d3fb7deaccac admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.528845 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14703a1a-7d85-4acd-a4da-d3fb7deaccac admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.529110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14703a1a-7d85-4acd-a4da-d3fb7deaccac admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.529766 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14703a1a-7d85-4acd-a4da-d3fb7deaccac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:23.531550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14703a1a-7d85-4acd-a4da-d3fb7deaccac admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:23.544611 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1402/2784] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:23.545645 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14703a1a-7d85-4acd-a4da-d3fb7deaccac admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.560980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14703a1a-7d85-4acd-a4da-d3fb7deaccac admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.581471 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74468265fe449fcb158fdb8003bde7c', 'request_id': 'req-03091b67-a6b8-450c-9319-6449c5a3e4a0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.582889 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:23.589606 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74468265fe449fcb158fdb8003bde7c', 'request_id': 'req-03091b67-a6b8-450c-9319-6449c5a3e4a0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.604171 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74468265fe449fcb158fdb8003bde7c', 'request_id': 'req-03091b67-a6b8-450c-9319-6449c5a3e4a0'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.623783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] The token cache is being invalidate because project b74468265fe449fcb158fdb8003bde7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:23.624448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.625575 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.627219 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1383/2785] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:23 2022] DELETE /identity/v3/projects/b74468265fe449fcb158fdb8003bde7c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:23.631249 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.632955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:23.639401 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca67b-a9bd-4301-a92f-5b158ac6d344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.640444 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca67b-a9bd-4301-a92f-5b158ac6d344 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.641005 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca67b-a9bd-4301-a92f-5b158ac6d344 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.641387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca67b-a9bd-4301-a92f-5b158ac6d344 admin admin] PATH_INFO: `/v3/projects/e2c0a6de850b455f81978abfa9d950e0/users/d36542fbb9004dbda141e48889da6da6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.660223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca67b-a9bd-4301-a92f-5b158ac6d344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c0a6de850b455f81978abfa9d950e0, user_id=d36542fbb9004dbda141e48889da6da6, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:23.663425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca67b-a9bd-4301-a92f-5b158ac6d344 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:23.688229 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1403/2786] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:23 2022] PUT /identity/v3/projects/e2c0a6de850b455f81978abfa9d950e0/users/d36542fbb9004dbda141e48889da6da6/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:23.704125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53530-b8ad-4184-97bc-76485afa07c8 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.704799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53530-b8ad-4184-97bc-76485afa07c8 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.705221 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53530-b8ad-4184-97bc-76485afa07c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.719248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091b67-a6b8-450c-9319-6449c5a3e4a0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.737058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-22e53530-b8ad-4184-97bc-76485afa07c8 None None] MFA Rules not processed for user `d36542fbb9004dbda141e48889da6da6`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:23.738232 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-22e53530-b8ad-4184-97bc-76485afa07c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:23.786208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.786867 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.787116 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.787388 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] PATH_INFO: `/v3/users/75ca426cae79440ab03d1ed6888681fc` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.788530 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ca426cae79440ab03d1ed6888681fc)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:23.790555 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:23.813761 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1404/2787] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:23.825814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53530-b8ad-4184-97bc-76485afa07c8 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:23.827443 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-22e53530-b8ad-4184-97bc-76485afa07c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:23.845953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ca426cae79440ab03d1ed6888681fc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.863068 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ca426cae79440ab03d1ed6888681fc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.863745 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ca426cae79440ab03d1ed6888681fc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.871586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ca426cae79440ab03d1ed6888681fc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.889474 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ca426cae79440ab03d1ed6888681fc'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:23.890147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:23.904225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1384/2788] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:23 2022] DELETE /identity/v3/users/75ca426cae79440ab03d1ed6888681fc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:23.904451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53530-b8ad-4184-97bc-76485afa07c8 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:23.964715 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300993f-6810-4de2-84fa-d7066e1cb849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:23.965328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300993f-6810-4de2-84fa-d7066e1cb849 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:23.965605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300993f-6810-4de2-84fa-d7066e1cb849 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:23.965876 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300993f-6810-4de2-84fa-d7066e1cb849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:23.967688 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b300993f-6810-4de2-84fa-d7066e1cb849 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:24.047416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300993f-6810-4de2-84fa-d7066e1cb849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:24.049571 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300993f-6810-4de2-84fa-d7066e1cb849 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:24.093869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1405/2789] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:24.295834 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:24.297419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:24.304591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:24.382272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c171e7-fad6-4768-95cf-87b2ab99477b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:24.388032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:24.388763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.389178 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.389337 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] PATH_INFO: `/v3/projects/9aa5c08e63864d388cd8c1559029e61e` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.402914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa5c08e63864d388cd8c1559029e61e)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:24.402914 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:24.480701 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa5c08e63864d388cd8c1559029e61e', 'request_id': 'req-51174508-a1a6-47b5-8188-2556d635bdd3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:24.488497 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa5c08e63864d388cd8c1559029e61e', 'request_id': 'req-51174508-a1a6-47b5-8188-2556d635bdd3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:24.496095 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa5c08e63864d388cd8c1559029e61e', 'request_id': 'req-51174508-a1a6-47b5-8188-2556d635bdd3'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:24.511405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] The token cache is being invalidate because project 9aa5c08e63864d388cd8c1559029e61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:24.511702 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:24.512485 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-51174508-a1a6-47b5-8188-2556d635bdd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:24.514618 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1385/2790] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:24 2022] DELETE /identity/v3/projects/9aa5c08e63864d388cd8c1559029e61e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:24.523158 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697b42-a3c2-4c0f-9f46-51ea3b832f12 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.523691 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697b42-a3c2-4c0f-9f46-51ea3b832f12 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.524074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697b42-a3c2-4c0f-9f46-51ea3b832f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.545939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-85697b42-a3c2-4c0f-9f46-51ea3b832f12 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:24.547241 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-85697b42-a3c2-4c0f-9f46-51ea3b832f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:24.612426 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1406/2791] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:24.620671 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe476-6f00-4569-a553-97a492775b59 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.620955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe476-6f00-4569-a553-97a492775b59 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.621235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe476-6f00-4569-a553-97a492775b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.641915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-6e7fe476-6f00-4569-a553-97a492775b59 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:24.643648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6e7fe476-6f00-4569-a553-97a492775b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:24.652301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1386/2792] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:24.656865 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85697b42-a3c2-4c0f-9f46-51ea3b832f12 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:24.666410 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85697b42-a3c2-4c0f-9f46-51ea3b832f12 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:24.671159 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:24.671787 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.672064 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.672336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.672978 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:24.673280 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:24.674905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:24.687004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1407/2793] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 00:38:24.692602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fe476-6f00-4569-a553-97a492775b59 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:24.702117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fe476-6f00-4569-a553-97a492775b59 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:24.707209 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50affb-c5b0-483a-94e9-04fa99f5de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:24.707798 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50affb-c5b0-483a-94e9-04fa99f5de7c admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.708074 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50affb-c5b0-483a-94e9-04fa99f5de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.708342 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50affb-c5b0-483a-94e9-04fa99f5de7c admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.709104 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50affb-c5b0-483a-94e9-04fa99f5de7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:24.711071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50affb-c5b0-483a-94e9-04fa99f5de7c admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:24.743685 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1387/2794] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:24 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:24.744784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:24.755814 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e355f60-0a2e-41a5-b3f0-1fbb023b66cf admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:24.798308 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=100 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:24.821607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632d15-0c58-4276-8c2a-3153ff2e3fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:24.822320 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632d15-0c58-4276-8c2a-3153ff2e3fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.822834 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632d15-0c58-4276-8c2a-3153ff2e3fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.822951 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632d15-0c58-4276-8c2a-3153ff2e3fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.823509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632d15-0c58-4276-8c2a-3153ff2e3fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:24.825441 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632d15-0c58-4276-8c2a-3153ff2e3fb3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:24.846710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1408/2795] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:24 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:38:24.851076 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50affb-c5b0-483a-94e9-04fa99f5de7c admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:24.863093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50affb-c5b0-483a-94e9-04fa99f5de7c admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:24.867275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d2cab-2770-4114-9183-73908bb00ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:24.867898 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d2cab-2770-4114-9183-73908bb00ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.868194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d2cab-2770-4114-9183-73908bb00ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.868469 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d2cab-2770-4114-9183-73908bb00ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.869111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d2cab-2770-4114-9183-73908bb00ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:24.870802 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d2cab-2770-4114-9183-73908bb00ed0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:24.882301 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1388/2796] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:24.886294 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632d15-0c58-4276-8c2a-3153ff2e3fb3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:24.896861 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632d15-0c58-4276-8c2a-3153ff2e3fb3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:24.901880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7fc77-4bd1-44ff-8939-2b381b978de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:24.902548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7fc77-4bd1-44ff-8939-2b381b978de1 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.902827 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7fc77-4bd1-44ff-8939-2b381b978de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.903097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7fc77-4bd1-44ff-8939-2b381b978de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.903735 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7fc77-4bd1-44ff-8939-2b381b978de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:24.905315 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7fc77-4bd1-44ff-8939-2b381b978de1 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:24.917125 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1409/2797] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:24.920648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d2cab-2770-4114-9183-73908bb00ed0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:24.931416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d2cab-2770-4114-9183-73908bb00ed0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:24.942512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:24.943188 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.943473 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.943744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] PATH_INFO: `/v3/projects/1c66d6193f19454192bb1fe16b2215d0/users/0875d06537b44beb9ebb59f3480f54d5/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:24.960343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c66d6193f19454192bb1fe16b2215d0, user_id=0875d06537b44beb9ebb59f3480f54d5, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:24.963024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:24.976917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1389/2798] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:24 2022] PUT /identity/v3/projects/1c66d6193f19454192bb1fe16b2215d0/users/0875d06537b44beb9ebb59f3480f54d5/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:24.989815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6e7d1-07df-4be7-9ec2-27d146bef81f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:24.990157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6e7d1-07df-4be7-9ec2-27d146bef81f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:24.990406 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6e7d1-07df-4be7-9ec2-27d146bef81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:25.018939 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-71b6e7d1-07df-4be7-9ec2-27d146bef81f None None] MFA Rules not processed for user `0875d06537b44beb9ebb59f3480f54d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:25.020153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-71b6e7d1-07df-4be7-9ec2-27d146bef81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:25.085155 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1410/2799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:25.096991 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:25.098725 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:25.134151 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:25.159464 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a88fa-4a74-4f57-9e3e-9d1007b2aef0 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:25.163083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040687d-d5fe-41c7-a8e0-ae24ed4408ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:25.163676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040687d-d5fe-41c7-a8e0-ae24ed4408ce service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:25.163958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040687d-d5fe-41c7-a8e0-ae24ed4408ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:25.164233 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040687d-d5fe-41c7-a8e0-ae24ed4408ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:25.172783 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040687d-d5fe-41c7-a8e0-ae24ed4408ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:25.174248 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040687d-d5fe-41c7-a8e0-ae24ed4408ce service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:25.182821 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1390/2800] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:25.204510 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6e7d1-07df-4be7-9ec2-27d146bef81f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:25.267249 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6e7d1-07df-4be7-9ec2-27d146bef81f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:25.271912 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:25.272525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:25.272802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:25.273083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] PATH_INFO: `/v3/users/0875d06537b44beb9ebb59f3480f54d5` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:25.274206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0875d06537b44beb9ebb59f3480f54d5)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:25.276082 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:25.322330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0875d06537b44beb9ebb59f3480f54d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.326008 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:25.331023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0875d06537b44beb9ebb59f3480f54d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.332015 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0875d06537b44beb9ebb59f3480f54d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.333387 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0875d06537b44beb9ebb59f3480f54d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.347782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0875d06537b44beb9ebb59f3480f54d5'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.361208 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1411/2801] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:25 2022] DELETE /identity/v3/users/0875d06537b44beb9ebb59f3480f54d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:25.365731 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3afd-9e1c-41e7-8c41-e89ae7c14d05 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:25.366027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3afd-9e1c-41e7-8c41-e89ae7c14d05 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:25.366355 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3afd-9e1c-41e7-8c41-e89ae7c14d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:25.385162 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-40fe3afd-9e1c-41e7-8c41-e89ae7c14d05 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:25.386147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-40fe3afd-9e1c-41e7-8c41-e89ae7c14d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:25.448684 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1391/2802] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:25.458599 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:25.459998 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:25.519765 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025a97-f957-46b9-8e7e-4e4c04a30c90 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:25.523492 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6911d-1073-4900-a3e2-919d18a16846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:25.524100 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6911d-1073-4900-a3e2-919d18a16846 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:25.524388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6911d-1073-4900-a3e2-919d18a16846 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:25.524643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6911d-1073-4900-a3e2-919d18a16846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:25.534813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6911d-1073-4900-a3e2-919d18a16846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:25.536266 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6911d-1073-4900-a3e2-919d18a16846 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:25.545752 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1412/2803] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:25.823664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe3afd-9e1c-41e7-8c41-e89ae7c14d05 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:25.825136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-40fe3afd-9e1c-41e7-8c41-e89ae7c14d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:25.837638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe3afd-9e1c-41e7-8c41-e89ae7c14d05 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:25.842261 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:25.842919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:25.843168 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:25.844113 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] PATH_INFO: `/v3/projects/1c66d6193f19454192bb1fe16b2215d0` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:25.845250 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c66d6193f19454192bb1fe16b2215d0)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:25.847189 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:25.898596 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c66d6193f19454192bb1fe16b2215d0', 'request_id': 'req-77abefe2-ac7a-4692-910e-b95df677e301'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.904026 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c66d6193f19454192bb1fe16b2215d0', 'request_id': 'req-77abefe2-ac7a-4692-910e-b95df677e301'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.910895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c66d6193f19454192bb1fe16b2215d0', 'request_id': 'req-77abefe2-ac7a-4692-910e-b95df677e301'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.924723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] The token cache is being invalidate because project 1c66d6193f19454192bb1fe16b2215d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:25.925136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.925769 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-77abefe2-ac7a-4692-910e-b95df677e301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:25.927288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1392/2804] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:25 2022] DELETE /identity/v3/projects/1c66d6193f19454192bb1fe16b2215d0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:25.932442 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62edf-a80e-40c5-a427-d886a2e3a91c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:25.932725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62edf-a80e-40c5-a427-d886a2e3a91c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:25.932994 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62edf-a80e-40c5-a427-d886a2e3a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:25.954386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-efa62edf-a80e-40c5-a427-d886a2e3a91c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:25.955578 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-efa62edf-a80e-40c5-a427-d886a2e3a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:26.016327 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1413/2805] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:26.025155 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d18aae-1ec0-439d-b5ba-05807760ee30 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.025449 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d18aae-1ec0-439d-b5ba-05807760ee30 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.025728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d18aae-1ec0-439d-b5ba-05807760ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.046626 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-89d18aae-1ec0-439d-b5ba-05807760ee30 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:26.047836 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-89d18aae-1ec0-439d-b5ba-05807760ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:26.056183 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1393/2806] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:26.060369 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa62edf-a80e-40c5-a427-d886a2e3a91c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:26.070398 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa62edf-a80e-40c5-a427-d886a2e3a91c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:26.074976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:26.075563 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.075843 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.076115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.076748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:26.077050 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:26.079291 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:26.090565 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1414/2807] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:38:26.094617 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d18aae-1ec0-439d-b5ba-05807760ee30 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:26.104225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d18aae-1ec0-439d-b5ba-05807760ee30 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:26.108839 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c63f-7ff6-409a-a74f-caeb6dd922b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:26.109456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c63f-7ff6-409a-a74f-caeb6dd922b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.109738 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c63f-7ff6-409a-a74f-caeb6dd922b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.110016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c63f-7ff6-409a-a74f-caeb6dd922b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.110741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c63f-7ff6-409a-a74f-caeb6dd922b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:26.112735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c63f-7ff6-409a-a74f-caeb6dd922b5 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:26.139006 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1394/2808] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:26 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:26.143504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:26.153330 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3cd0b-7007-43cb-b526-1901d351e7a3 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:26.209020 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f78680-aedd-4acc-8ee4-3a2e4a78ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:26.209613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78680-aedd-4acc-8ee4-3a2e4a78ee02 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.209894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78680-aedd-4acc-8ee4-3a2e4a78ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.210198 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78680-aedd-4acc-8ee4-3a2e4a78ee02 admin admin] PATH_INFO: `/v3/users` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.210822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f78680-aedd-4acc-8ee4-3a2e4a78ee02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:26.212710 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f78680-aedd-4acc-8ee4-3a2e4a78ee02 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:26.220924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:26.234437 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1415/2809] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:26 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:26.239024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c63f-7ff6-409a-a74f-caeb6dd922b5 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:26.249321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c63f-7ff6-409a-a74f-caeb6dd922b5 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:26.254028 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b65f6-5fed-4155-95db-fa36a3517178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:26.254657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b65f6-5fed-4155-95db-fa36a3517178 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.254936 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b65f6-5fed-4155-95db-fa36a3517178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.255207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b65f6-5fed-4155-95db-fa36a3517178 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.255891 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b65f6-5fed-4155-95db-fa36a3517178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:26.257472 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b65f6-5fed-4155-95db-fa36a3517178 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:26.267673 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1395/2810] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:26.271671 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f78680-aedd-4acc-8ee4-3a2e4a78ee02 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:26.282092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f78680-aedd-4acc-8ee4-3a2e4a78ee02 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:26.286910 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7507b03-85ab-4267-919e-261376326085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:26.287556 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7507b03-85ab-4267-919e-261376326085 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.287841 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7507b03-85ab-4267-919e-261376326085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.288114 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7507b03-85ab-4267-919e-261376326085 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.288772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7507b03-85ab-4267-919e-261376326085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:26.290440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7507b03-85ab-4267-919e-261376326085 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:26.300847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1416/2811] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:26.304828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b65f6-5fed-4155-95db-fa36a3517178 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:26.314658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b65f6-5fed-4155-95db-fa36a3517178 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:26.319294 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:26.319924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.320206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.320483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] PATH_INFO: `/v3/projects/910287a20f4b41ba958dc5a33084a895/users/b8d8a45ae4544591bb7cad35b65769d5/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.336357 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910287a20f4b41ba958dc5a33084a895, user_id=b8d8a45ae4544591bb7cad35b65769d5, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:26.339084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:26.341281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:26.354811 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1396/2812] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:26 2022] PUT /identity/v3/projects/910287a20f4b41ba958dc5a33084a895/users/b8d8a45ae4544591bb7cad35b65769d5/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:26.365182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc99d-589c-48c4-ba10-7aba94f85f46 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.365392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc99d-589c-48c4-ba10-7aba94f85f46 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.365668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc99d-589c-48c4-ba10-7aba94f85f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.393290 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-61bcc99d-589c-48c4-ba10-7aba94f85f46 None None] MFA Rules not processed for user `b8d8a45ae4544591bb7cad35b65769d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:26.394543 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-61bcc99d-589c-48c4-ba10-7aba94f85f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:26.456732 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1417/2813] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:26.467971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:26.470218 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:26.527906 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42ebdb-32fe-4702-8128-8d36dbbf8054 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:26.532213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:26.532849 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:26.533126 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:26.533397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:26.541741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:26.543226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:26.551971 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1397/2814] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:27.930839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39b2fe-6c9c-4f43-b086-0d86deb48be1 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:27.931353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39b2fe-6c9c-4f43-b086-0d86deb48be1 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:27.931353 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39b2fe-6c9c-4f43-b086-0d86deb48be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:27.950120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-6e39b2fe-6c9c-4f43-b086-0d86deb48be1 None None] MFA Rules not processed for user `b8d8a45ae4544591bb7cad35b65769d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:27.951299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6e39b2fe-6c9c-4f43-b086-0d86deb48be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:27.958122 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1418/2815] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:29.570424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:29.571959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:29.639200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5842705-f0de-4815-adbc-78c12fa7fba6 service cinder] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:29.644015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:29.644637 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:29.644917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:29.645192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] PATH_INFO: `/v3/users/d36542fbb9004dbda141e48889da6da6` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:29.646359 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36542fbb9004dbda141e48889da6da6)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:29.648268 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:29.695789 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36542fbb9004dbda141e48889da6da6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:29.703489 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36542fbb9004dbda141e48889da6da6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:29.704145 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36542fbb9004dbda141e48889da6da6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:29.711619 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36542fbb9004dbda141e48889da6da6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:29.724156 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36542fbb9004dbda141e48889da6da6'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:29.730032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1398/2816] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:29 2022] DELETE /identity/v3/users/d36542fbb9004dbda141e48889da6da6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:29.734995 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb08c7-43e2-4e79-b3f1-68163251909a None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:29.735470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb08c7-43e2-4e79-b3f1-68163251909a None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:29.735569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb08c7-43e2-4e79-b3f1-68163251909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:29.755486 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-37bb08c7-43e2-4e79-b3f1-68163251909a None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:29.756815 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-37bb08c7-43e2-4e79-b3f1-68163251909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:29.830095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1419/2817] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:29.840071 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:29.842225 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:29.866598 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:29.913628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47c161-d26f-4ad9-88f2-ac926520bd64 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:29.917663 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a73f11-4c9e-4b3a-b51c-7ab8e79bfa91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:29.918448 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a73f11-4c9e-4b3a-b51c-7ab8e79bfa91 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:29.918967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a73f11-4c9e-4b3a-b51c-7ab8e79bfa91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:29.920206 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a73f11-4c9e-4b3a-b51c-7ab8e79bfa91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:29.931704 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a73f11-4c9e-4b3a-b51c-7ab8e79bfa91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:29.937488 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a73f11-4c9e-4b3a-b51c-7ab8e79bfa91 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:29.949919 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1399/2818] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:38:30.469172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb08c7-43e2-4e79-b3f1-68163251909a None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:30.470730 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-37bb08c7-43e2-4e79-b3f1-68163251909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:30.483000 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb08c7-43e2-4e79-b3f1-68163251909a None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:30.488945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:30.489662 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:30.490018 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:30.490393 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] PATH_INFO: `/v3/projects/e2c0a6de850b455f81978abfa9d950e0` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:30.491612 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c0a6de850b455f81978abfa9d950e0)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:30.493587 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:30.545544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c0a6de850b455f81978abfa9d950e0', 'request_id': 'req-a09d644b-b4b7-4537-8adc-a69f65def13d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:30.550643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:INSERT=3,keystone:SELECT=91,keystone:DELETE=6 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:30.551917 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c0a6de850b455f81978abfa9d950e0', 'request_id': 'req-a09d644b-b4b7-4537-8adc-a69f65def13d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:30.559126 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c0a6de850b455f81978abfa9d950e0', 'request_id': 'req-a09d644b-b4b7-4537-8adc-a69f65def13d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:30.572851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] The token cache is being invalidate because project e2c0a6de850b455f81978abfa9d950e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:30.572851 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:30.573366 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-a09d644b-b4b7-4537-8adc-a69f65def13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:30.574920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1420/2819] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:30 2022] DELETE /identity/v3/projects/e2c0a6de850b455f81978abfa9d950e0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:30.579775 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b81e0-8097-4a09-8b34-7fbf8bd2c700 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:30.580763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b81e0-8097-4a09-8b34-7fbf8bd2c700 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:30.581213 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b81e0-8097-4a09-8b34-7fbf8bd2c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:30.603688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-509b81e0-8097-4a09-8b34-7fbf8bd2c700 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:30.604933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-509b81e0-8097-4a09-8b34-7fbf8bd2c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:30.677761 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1400/2820] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:38:30.685099 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ba0d-5861-46e6-b2cc-98f0ee5d5d0d None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:30.685700 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ba0d-5861-46e6-b2cc-98f0ee5d5d0d None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:30.686595 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ba0d-5861-46e6-b2cc-98f0ee5d5d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:30.715427 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-b917ba0d-5861-46e6-b2cc-98f0ee5d5d0d None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:30.716670 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b917ba0d-5861-46e6-b2cc-98f0ee5d5d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:30.729063 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1421/2821] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:30.730329 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b81e0-8097-4a09-8b34-7fbf8bd2c700 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:30.750494 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b81e0-8097-4a09-8b34-7fbf8bd2c700 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:30.757648 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:30.758313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:30.758995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:30.758995 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:30.759592 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:30.759905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:30.762049 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:30.782613 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1401/2822] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:38:30.787106 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ba0d-5861-46e6-b2cc-98f0ee5d5d0d None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:30.797214 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ba0d-5861-46e6-b2cc-98f0ee5d5d0d None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:30.806989 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533687d-717b-47a9-a7ad-3b1d30ef3bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:30.807973 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533687d-717b-47a9-a7ad-3b1d30ef3bdc admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:30.808421 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533687d-717b-47a9-a7ad-3b1d30ef3bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:30.808696 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533687d-717b-47a9-a7ad-3b1d30ef3bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:30.809344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533687d-717b-47a9-a7ad-3b1d30ef3bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:30.811415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533687d-717b-47a9-a7ad-3b1d30ef3bdc admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:30.864564 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1422/2823] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:30 2022] POST /identity/v3/projects => generated 361 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:30.868721 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:30.881418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b1181-a1b4-4c79-a51c-9373a745788e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:30.942594 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b748fd-b1c3-4fe3-8dcd-cfbdaf3185c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:30.943336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b748fd-b1c3-4fe3-8dcd-cfbdaf3185c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:30.943657 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b748fd-b1c3-4fe3-8dcd-cfbdaf3185c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:30.943957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b748fd-b1c3-4fe3-8dcd-cfbdaf3185c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:30.944735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b748fd-b1c3-4fe3-8dcd-cfbdaf3185c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:30.946895 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b748fd-b1c3-4fe3-8dcd-cfbdaf3185c9 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:30.967967 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1402/2824] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:30 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:30.972083 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533687d-717b-47a9-a7ad-3b1d30ef3bdc admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:30.982149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533687d-717b-47a9-a7ad-3b1d30ef3bdc admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:30.987892 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1025c9-ab4c-4162-b6ef-922e5b0f0ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:30.988498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1025c9-ab4c-4162-b6ef-922e5b0f0ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:30.988781 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1025c9-ab4c-4162-b6ef-922e5b0f0ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:30.989051 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1025c9-ab4c-4162-b6ef-922e5b0f0ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:30.989695 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1025c9-ab4c-4162-b6ef-922e5b0f0ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:30.991325 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1025c9-ab4c-4162-b6ef-922e5b0f0ed5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:31.003868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1423/2825] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:31.007866 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b748fd-b1c3-4fe3-8dcd-cfbdaf3185c9 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:31.022764 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b748fd-b1c3-4fe3-8dcd-cfbdaf3185c9 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:31.030232 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1add7e-cb0c-4195-8ef8-a84e65278ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:31.030875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1add7e-cb0c-4195-8ef8-a84e65278ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:31.031166 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1add7e-cb0c-4195-8ef8-a84e65278ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:31.031446 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1add7e-cb0c-4195-8ef8-a84e65278ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:31.032255 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1add7e-cb0c-4195-8ef8-a84e65278ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:31.034025 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1add7e-cb0c-4195-8ef8-a84e65278ec7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:31.045860 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1403/2826] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:38:31.050888 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1025c9-ab4c-4162-b6ef-922e5b0f0ed5 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:31.061388 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1025c9-ab4c-4162-b6ef-922e5b0f0ed5 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:31.066170 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:31.066819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:31.067097 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:31.067371 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] PATH_INFO: `/v3/projects/755f4e064165445d9040bcc104cd4d83/users/4614ef97e7b84e4c8a4f79d0afc95e46/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:31.084152 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755f4e064165445d9040bcc104cd4d83, user_id=4614ef97e7b84e4c8a4f79d0afc95e46, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:31.086869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:31.100336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1424/2827] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:31 2022] PUT /identity/v3/projects/755f4e064165445d9040bcc104cd4d83/users/4614ef97e7b84e4c8a4f79d0afc95e46/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:31.111108 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c7c1-3a14-4158-856b-809313fc8284 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:31.111402 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c7c1-3a14-4158-856b-809313fc8284 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:31.111683 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c7c1-3a14-4158-856b-809313fc8284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:31.139541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-39e0c7c1-3a14-4158-856b-809313fc8284 None None] MFA Rules not processed for user `4614ef97e7b84e4c8a4f79d0afc95e46`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:31.140880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-39e0c7c1-3a14-4158-856b-809313fc8284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:31.153069 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:31.212567 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1404/2828] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:31.251663 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:31.253476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:31.355709 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c93c2c-3419-4455-b2ad-25a6d8965a68 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:31.360558 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6eee-e47c-4f51-a78d-f0c698cb1525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:31.361374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6eee-e47c-4f51-a78d-f0c698cb1525 service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:31.361755 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6eee-e47c-4f51-a78d-f0c698cb1525 service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:31.362175 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6eee-e47c-4f51-a78d-f0c698cb1525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:31.375173 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6eee-e47c-4f51-a78d-f0c698cb1525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:31.378095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6eee-e47c-4f51-a78d-f0c698cb1525 service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:31.403629 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1425/2829] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:31.412504 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0c7c1-3a14-4158-856b-809313fc8284 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:31.499273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0c7c1-3a14-4158-856b-809313fc8284 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:31.506160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:31.506980 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:31.507361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:31.507875 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] PATH_INFO: `/v3/users/4614ef97e7b84e4c8a4f79d0afc95e46` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:31.509163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4614ef97e7b84e4c8a4f79d0afc95e46)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:31.511422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:31.572439 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4614ef97e7b84e4c8a4f79d0afc95e46'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:31.580244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4614ef97e7b84e4c8a4f79d0afc95e46'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:31.580886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4614ef97e7b84e4c8a4f79d0afc95e46'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:31.587825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4614ef97e7b84e4c8a4f79d0afc95e46'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:31.601602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4614ef97e7b84e4c8a4f79d0afc95e46'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:31.608422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1405/2830] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:31 2022] DELETE /identity/v3/users/4614ef97e7b84e4c8a4f79d0afc95e46 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:31.613368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43200c0d-7e9c-4286-8550-99157746503f None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:31.613569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43200c0d-7e9c-4286-8550-99157746503f None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:31.613950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43200c0d-7e9c-4286-8550-99157746503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:31.636264 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-43200c0d-7e9c-4286-8550-99157746503f None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:31.637511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-43200c0d-7e9c-4286-8550-99157746503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:31.708687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1426/2831] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:31.718850 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:31.720288 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:31.773272 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:31.805535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3005e-2fd2-4dc8-9798-c88d9679d791 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:31.811164 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65734504-e724-4765-8b72-47369a30c984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:31.811948 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734504-e724-4765-8b72-47369a30c984 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:31.812331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734504-e724-4765-8b72-47369a30c984 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:31.812707 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734504-e724-4765-8b72-47369a30c984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:31.824327 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65734504-e724-4765-8b72-47369a30c984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:31.825705 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65734504-e724-4765-8b72-47369a30c984 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:31.836959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1406/2832] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:32.147019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43200c0d-7e9c-4286-8550-99157746503f None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:32.148523 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-43200c0d-7e9c-4286-8550-99157746503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:32.165813 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43200c0d-7e9c-4286-8550-99157746503f None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:32.170717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:32.171204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.171475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.171809 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] PATH_INFO: `/v3/projects/755f4e064165445d9040bcc104cd4d83` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.172897 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755f4e064165445d9040bcc104cd4d83)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:32.174784 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:32.185630 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:32.225512 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755f4e064165445d9040bcc104cd4d83', 'request_id': 'req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:32.231385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755f4e064165445d9040bcc104cd4d83', 'request_id': 'req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:32.238056 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755f4e064165445d9040bcc104cd4d83', 'request_id': 'req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:32.253057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] The token cache is being invalidate because project 755f4e064165445d9040bcc104cd4d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:32.253349 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:32.254022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-dc1212a0-7223-4bb9-9c76-15be7c8f9fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:32.256819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1427/2833] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:32 2022] DELETE /identity/v3/projects/755f4e064165445d9040bcc104cd4d83 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:32.261800 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428d127-f336-498c-8349-1650f3ee034b None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.262182 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428d127-f336-498c-8349-1650f3ee034b None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.262553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428d127-f336-498c-8349-1650f3ee034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.282712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-5428d127-f336-498c-8349-1650f3ee034b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:32.284066 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-5428d127-f336-498c-8349-1650f3ee034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:32.353401 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1407/2834] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:32.417791 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54da0-3c0e-42e8-ab10-087b345c8cce None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.418095 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54da0-3c0e-42e8-ab10-087b345c8cce None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.418384 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54da0-3c0e-42e8-ab10-087b345c8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.438714 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-93f54da0-3c0e-42e8-ab10-087b345c8cce None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:32.439918 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-93f54da0-3c0e-42e8-ab10-087b345c8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:32.447759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1428/2835] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:32.452031 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428d127-f336-498c-8349-1650f3ee034b None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:32.461754 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428d127-f336-498c-8349-1650f3ee034b None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:32.466547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:32.467214 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.467498 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.467771 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.468459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:38:32.468763 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:32.470467 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:32.482091 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1408/2836] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:38:32.487279 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f54da0-3c0e-42e8-ab10-087b345c8cce None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:32.496386 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f54da0-3c0e-42e8-ab10-087b345c8cce None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:32.501615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f84de-4095-456a-a174-27f7f5c45f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:32.502243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f84de-4095-456a-a174-27f7f5c45f89 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.502525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f84de-4095-456a-a174-27f7f5c45f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.502799 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f84de-4095-456a-a174-27f7f5c45f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.503418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f84de-4095-456a-a174-27f7f5c45f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:32.505321 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f84de-4095-456a-a174-27f7f5c45f89 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:32.533145 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1429/2837] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:38:32 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:32.537383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:32.547976 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63183a7-1357-4c48-a0ae-6c6c278de3af admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:32.609253 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fae7a-9439-43e1-9a8f-e5364d5a16ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:32.609917 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fae7a-9439-43e1-9a8f-e5364d5a16ee admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.610102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fae7a-9439-43e1-9a8f-e5364d5a16ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.610369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fae7a-9439-43e1-9a8f-e5364d5a16ee admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.611009 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fae7a-9439-43e1-9a8f-e5364d5a16ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:32.612940 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fae7a-9439-43e1-9a8f-e5364d5a16ee admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:32.635591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1409/2838] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:38:32 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:38:32.639925 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f84de-4095-456a-a174-27f7f5c45f89 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:32.650573 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f84de-4095-456a-a174-27f7f5c45f89 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:32.655191 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbe05c-eb85-4d44-adeb-15fd8e5ec6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:32.656261 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbe05c-eb85-4d44-adeb-15fd8e5ec6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.656548 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbe05c-eb85-4d44-adeb-15fd8e5ec6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.656819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbe05c-eb85-4d44-adeb-15fd8e5ec6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.657464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbe05c-eb85-4d44-adeb-15fd8e5ec6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:32.659074 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbe05c-eb85-4d44-adeb-15fd8e5ec6b9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:32.668794 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1430/2839] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:32.673572 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fae7a-9439-43e1-9a8f-e5364d5a16ee admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:32.684045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fae7a-9439-43e1-9a8f-e5364d5a16ee admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:32.688647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca95f9-3671-45ec-a733-8c1a5cbf4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:32.689235 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca95f9-3671-45ec-a733-8c1a5cbf4005 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.689522 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca95f9-3671-45ec-a733-8c1a5cbf4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.689784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca95f9-3671-45ec-a733-8c1a5cbf4005 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.690481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca95f9-3671-45ec-a733-8c1a5cbf4005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:32.692169 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca95f9-3671-45ec-a733-8c1a5cbf4005 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:32.702638 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1410/2840] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:38:32.706877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbe05c-eb85-4d44-adeb-15fd8e5ec6b9 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:32.716976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbe05c-eb85-4d44-adeb-15fd8e5ec6b9 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:32.723059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:32.724172 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.724659 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.725160 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] PATH_INFO: `/v3/projects/491380629a494f11856f2c8ed1f12f78/users/e91f9a4f99e4436bbd0ba0807c307c08/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.741285 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491380629a494f11856f2c8ed1f12f78, user_id=e91f9a4f99e4436bbd0ba0807c307c08, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:32.743970 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:32.757435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1431/2841] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:38:32 2022] PUT /identity/v3/projects/491380629a494f11856f2c8ed1f12f78/users/e91f9a4f99e4436bbd0ba0807c307c08/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:38:32.768080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621df2f-7bb6-4d3f-a134-335d40fc274a None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.768368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621df2f-7bb6-4d3f-a134-335d40fc274a None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.768641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621df2f-7bb6-4d3f-a134-335d40fc274a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.795641 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-a621df2f-7bb6-4d3f-a134-335d40fc274a None None] MFA Rules not processed for user `e91f9a4f99e4436bbd0ba0807c307c08`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:32.797369 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a621df2f-7bb6-4d3f-a134-335d40fc274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:32.826827 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:32.862708 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1411/2842] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:32.874027 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:32.875870 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:32.931561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f3fa6-3794-42ae-8c5f-18ba5445a093 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:32.935176 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9686-5564-4f2e-ad27-a1153d5c90bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064dcac38bd1416f93bb1b763cb89f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:32.935763 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9686-5564-4f2e-ad27-a1153d5c90bd service cinder] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:32.936040 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9686-5564-4f2e-ad27-a1153d5c90bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:32.936311 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9686-5564-4f2e-ad27-a1153d5c90bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:32.944365 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9686-5564-4f2e-ad27-a1153d5c90bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:32.945771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9686-5564-4f2e-ad27-a1153d5c90bd service cinder] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:32.954344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1432/2843] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:35.381664 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621df2f-7bb6-4d3f-a134-335d40fc274a None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:35.383475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a621df2f-7bb6-4d3f-a134-335d40fc274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:35.474828 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621df2f-7bb6-4d3f-a134-335d40fc274a None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:35.487835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:35.488455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:35.488805 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:35.489008 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:35.491564 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:35.581093 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:35.582666 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:35.594234 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1412/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:37.969605 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9686-5564-4f2e-ad27-a1153d5c90bd service cinder] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:38.019586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:38.051348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9686-5564-4f2e-ad27-a1153d5c90bd service cinder] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:38.055803 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:38.056500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:38.056776 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:38.057044 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] PATH_INFO: `/v3/users/e91f9a4f99e4436bbd0ba0807c307c08` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:38.058188 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91f9a4f99e4436bbd0ba0807c307c08)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:38.060078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:38.069920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:38.080039 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2036b-96cf-4448-ac71-36bcde11e746 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:38.084425 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc8f59-7168-4fb4-9a27-1c29c7c2ef9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:38.085036 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8f59-7168-4fb4-9a27-1c29c7c2ef9e service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:38.085331 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8f59-7168-4fb4-9a27-1c29c7c2ef9e service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:38.085589 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8f59-7168-4fb4-9a27-1c29c7c2ef9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:38.087484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dfbc8f59-7168-4fb4-9a27-1c29c7c2ef9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:38.104700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc8f59-7168-4fb4-9a27-1c29c7c2ef9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:38.106730 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc8f59-7168-4fb4-9a27-1c29c7c2ef9e service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:38.121338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91f9a4f99e4436bbd0ba0807c307c08'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.128060 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1413/2845] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:38.132770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91f9a4f99e4436bbd0ba0807c307c08'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.133456 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91f9a4f99e4436bbd0ba0807c307c08'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.134207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91f9a4f99e4436bbd0ba0807c307c08'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.153768 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91f9a4f99e4436bbd0ba0807c307c08'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.174301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1433/2846] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:37 2022] DELETE /identity/v3/users/e91f9a4f99e4436bbd0ba0807c307c08 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:38.176979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e182d-b2ce-47e8-920a-b68efbc68627 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:38.177323 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e182d-b2ce-47e8-920a-b68efbc68627 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:38.177658 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e182d-b2ce-47e8-920a-b68efbc68627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:38.201059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-c94e182d-b2ce-47e8-920a-b68efbc68627 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:38.202882 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c94e182d-b2ce-47e8-920a-b68efbc68627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:38.252676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=100 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:38.261549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1414/2847] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:38.272748 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:38.274207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:38.333717 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f931da-0649-4830-aa3d-c56b2598a050 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:38.337206 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f458b6c-ec17-46db-9a47-61b0fae0e2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:38.337797 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458b6c-ec17-46db-9a47-61b0fae0e2ff service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:38.338086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458b6c-ec17-46db-9a47-61b0fae0e2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:38.338374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458b6c-ec17-46db-9a47-61b0fae0e2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:38.347244 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f458b6c-ec17-46db-9a47-61b0fae0e2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:38.348643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f458b6c-ec17-46db-9a47-61b0fae0e2ff service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:38.357820 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1434/2848] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:38.634692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e182d-b2ce-47e8-920a-b68efbc68627 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:38.636191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-c94e182d-b2ce-47e8-920a-b68efbc68627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:38.651211 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e182d-b2ce-47e8-920a-b68efbc68627 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:38.656590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:38.657899 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:38.658226 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:38.658508 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] PATH_INFO: `/v3/projects/491380629a494f11856f2c8ed1f12f78` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:38.659676 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491380629a494f11856f2c8ed1f12f78)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:38.661537 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:38.710979 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491380629a494f11856f2c8ed1f12f78', 'request_id': 'req-82c5b20a-0ec6-438c-879f-3d1528530789'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.717500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491380629a494f11856f2c8ed1f12f78', 'request_id': 'req-82c5b20a-0ec6-438c-879f-3d1528530789'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.724395 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491380629a494f11856f2c8ed1f12f78', 'request_id': 'req-82c5b20a-0ec6-438c-879f-3d1528530789'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.737127 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] The token cache is being invalidate because project 491380629a494f11856f2c8ed1f12f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:38.737404 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.738032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-82c5b20a-0ec6-438c-879f-3d1528530789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:38.739945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1415/2849] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:38 2022] DELETE /identity/v3/projects/491380629a494f11856f2c8ed1f12f78 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:40.375958 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de671a-7105-437e-aac2-cbd0211518cf None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:40.376428 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de671a-7105-437e-aac2-cbd0211518cf None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:40.376541 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de671a-7105-437e-aac2-cbd0211518cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:40.397536 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-d7de671a-7105-437e-aac2-cbd0211518cf None None] MFA Rules not processed for user `8003251c1d9a4ac1a9f2ff5bb2987daf`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:40.398777 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d7de671a-7105-437e-aac2-cbd0211518cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:40.453260 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1435/2850] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:44.505507 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c9e0-48c4-4830-8f6b-b634e8ae2254 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:44.506251 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c9e0-48c4-4830-8f6b-b634e8ae2254 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:44.506412 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c9e0-48c4-4830-8f6b-b634e8ae2254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:44.526717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-3066c9e0-48c4-4830-8f6b-b634e8ae2254 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:44.528027 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3066c9e0-48c4-4830-8f6b-b634e8ae2254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:44.585023 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1416/2851] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:38:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:44.638281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de671a-7105-437e-aac2-cbd0211518cf None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:44.639059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-d7de671a-7105-437e-aac2-cbd0211518cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:44.646217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:44.712725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de671a-7105-437e-aac2-cbd0211518cf None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:44.717668 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541f37-6477-4262-b4d3-99a46fb9db3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:44.718362 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541f37-6477-4262-b4d3-99a46fb9db3c service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:44.718641 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541f37-6477-4262-b4d3-99a46fb9db3c service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:44.718909 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541f37-6477-4262-b4d3-99a46fb9db3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:44.727016 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541f37-6477-4262-b4d3-99a46fb9db3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:44.728574 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541f37-6477-4262-b4d3-99a46fb9db3c service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:44.736956 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1436/2852] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:38:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:38:45.232435 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f90a6-5e38-413b-a164-4f84bd34488d None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:45.232717 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f90a6-5e38-413b-a164-4f84bd34488d None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:45.233018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f90a6-5e38-413b-a164-4f84bd34488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:45.252307 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-084f90a6-5e38-413b-a164-4f84bd34488d None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:45.253500 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-084f90a6-5e38-413b-a164-4f84bd34488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:45.261041 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1417/2853] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 00:38:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:45.273718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541f37-6477-4262-b4d3-99a46fb9db3c service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:45.285348 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541f37-6477-4262-b4d3-99a46fb9db3c service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:45.290374 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31387721-c470-4c41-a5c1-092d9e77d4cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:45.290948 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31387721-c470-4c41-a5c1-092d9e77d4cd service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:45.291234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31387721-c470-4c41-a5c1-092d9e77d4cd service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:45.291503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31387721-c470-4c41-a5c1-092d9e77d4cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:45.299354 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31387721-c470-4c41-a5c1-092d9e77d4cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:45.300945 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31387721-c470-4c41-a5c1-092d9e77d4cd service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:45.308828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1437/2854] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:38:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:38:45.524913 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a03d8-1b22-41e5-9167-231602cf6756 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:45.525375 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a03d8-1b22-41e5-9167-231602cf6756 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:45.525517 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a03d8-1b22-41e5-9167-231602cf6756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:45.544275 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-493a03d8-1b22-41e5-9167-231602cf6756 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:45.545604 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-493a03d8-1b22-41e5-9167-231602cf6756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:45.553417 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1418/2855] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:38:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:45.565729 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31387721-c470-4c41-a5c1-092d9e77d4cd service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:45.576157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31387721-c470-4c41-a5c1-092d9e77d4cd service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:45.581744 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92a087-8d2c-4f35-9911-979586a88e1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:45.582380 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a087-8d2c-4f35-9911-979586a88e1d service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:45.582656 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a087-8d2c-4f35-9911-979586a88e1d service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:45.582924 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a087-8d2c-4f35-9911-979586a88e1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:45.590638 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92a087-8d2c-4f35-9911-979586a88e1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:45.592189 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92a087-8d2c-4f35-9911-979586a88e1d service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:45.601884 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1438/2856] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:38:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 00:38:45.933945 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4d36-6ea3-4ebf-ba17-8825a81d6297 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:45.934336 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4d36-6ea3-4ebf-ba17-8825a81d6297 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:45.934620 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d4d36-6ea3-4ebf-ba17-8825a81d6297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:45.953944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-e59d4d36-6ea3-4ebf-ba17-8825a81d6297 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:45.955180 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e59d4d36-6ea3-4ebf-ba17-8825a81d6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:45.962298 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1419/2857] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 00:38:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:45.974022 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92a087-8d2c-4f35-9911-979586a88e1d service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:45.984585 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92a087-8d2c-4f35-9911-979586a88e1d service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:45.990086 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175ba3-6255-44c2-bb28-9632c1171014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:45.990689 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175ba3-6255-44c2-bb28-9632c1171014 service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:45.990966 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175ba3-6255-44c2-bb28-9632c1171014 service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:45.991234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175ba3-6255-44c2-bb28-9632c1171014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:45.998980 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175ba3-6255-44c2-bb28-9632c1171014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:46.001213 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175ba3-6255-44c2-bb28-9632c1171014 service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:46.009021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1439/2858] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:38:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:38:48.084588 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d4d36-6ea3-4ebf-ba17-8825a81d6297 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:48.085986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-e59d4d36-6ea3-4ebf-ba17-8825a81d6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:48.152149 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d4d36-6ea3-4ebf-ba17-8825a81d6297 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:48.156677 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:48.157312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:48.157580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:48.157856 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] PATH_INFO: `/v3/users/b8d8a45ae4544591bb7cad35b65769d5` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:48.159032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d8a45ae4544591bb7cad35b65769d5)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:48.160949 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:48.172084 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:48.213845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d8a45ae4544591bb7cad35b65769d5'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.221593 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d8a45ae4544591bb7cad35b65769d5'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.222263 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d8a45ae4544591bb7cad35b65769d5'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.229585 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d8a45ae4544591bb7cad35b65769d5'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.242942 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d8a45ae4544591bb7cad35b65769d5'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.249512 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1420/2859] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:38:48 2022] DELETE /identity/v3/users/b8d8a45ae4544591bb7cad35b65769d5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:48.253855 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7f97-61eb-430d-abdf-e895ae104b99 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:48.254363 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7f97-61eb-430d-abdf-e895ae104b99 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:48.254463 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7f97-61eb-430d-abdf-e895ae104b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:48.276952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-fd1b7f97-61eb-430d-abdf-e895ae104b99 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:48.278178 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fd1b7f97-61eb-430d-abdf-e895ae104b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:48.336014 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1440/2860] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:48.345692 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:48.347117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:48.405333 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d22d6-6085-42e9-9356-6a5f9a37bd83 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:48.409343 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79190e-29f4-4fcf-a097-a1de12812ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:48.409939 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79190e-29f4-4fcf-a097-a1de12812ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:48.410257 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79190e-29f4-4fcf-a097-a1de12812ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:48.410534 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79190e-29f4-4fcf-a097-a1de12812ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:48.419490 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79190e-29f4-4fcf-a097-a1de12812ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:48.420920 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79190e-29f4-4fcf-a097-a1de12812ca2 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:48.430825 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1421/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:38:48.597243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7f97-61eb-430d-abdf-e895ae104b99 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:48.599105 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-fd1b7f97-61eb-430d-abdf-e895ae104b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:48.615120 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7f97-61eb-430d-abdf-e895ae104b99 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:48.619854 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:48.620490 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:48.620895 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:48.621180 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] PATH_INFO: `/v3/projects/910287a20f4b41ba958dc5a33084a895` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:48.622332 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=910287a20f4b41ba958dc5a33084a895)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:48.624223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:48.670802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910287a20f4b41ba958dc5a33084a895', 'request_id': 'req-952e8100-cf60-49e7-a255-003a21afe76d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.672026 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:48.678379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910287a20f4b41ba958dc5a33084a895', 'request_id': 'req-952e8100-cf60-49e7-a255-003a21afe76d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.684667 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910287a20f4b41ba958dc5a33084a895', 'request_id': 'req-952e8100-cf60-49e7-a255-003a21afe76d'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.697323 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] The token cache is being invalidate because project 910287a20f4b41ba958dc5a33084a895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:38:48.697633 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.698281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:38:48.699757 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1441/2862] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:38:48 2022] DELETE /identity/v3/projects/910287a20f4b41ba958dc5a33084a895 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:38:57.441688 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee350f0-f1e0-4261-b42c-282881ad46f1 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:57.442373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee350f0-f1e0-4261-b42c-282881ad46f1 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:57.442373 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee350f0-f1e0-4261-b42c-282881ad46f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:57.492075 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-1ee350f0-f1e0-4261-b42c-282881ad46f1 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:38:57.493371 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-1ee350f0-f1e0-4261-b42c-282881ad46f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:57.557010 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1422/2863] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:38:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:38:57.569066 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:38:57.570483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:38:57.663904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e8100-cf60-49e7-a255-003a21afe76d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:38:57.668896 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c1f2e-7c99-45cf-a8cf-2c58c6324737 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:38:57.669498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c1f2e-7c99-45cf-a8cf-2c58c6324737 service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:38:57.669782 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c1f2e-7c99-45cf-a8cf-2c58c6324737 service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:38:57.670057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c1f2e-7c99-45cf-a8cf-2c58c6324737 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:38:57.678651 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c1f2e-7c99-45cf-a8cf-2c58c6324737 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:38:57.680217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c1f2e-7c99-45cf-a8cf-2c58c6324737 service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:38:57.688103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1442/2864] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:38:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:39:07.554256 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:07.685081 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:DELETE=3,keystone:SELECT=47,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:12.045101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630db10-292f-4545-a158-d0899f0d7823 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:12.045573 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630db10-292f-4545-a158-d0899f0d7823 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:12.045694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630db10-292f-4545-a158-d0899f0d7823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:12.066198 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-9630db10-292f-4545-a158-d0899f0d7823 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:12.067374 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9630db10-292f-4545-a158-d0899f0d7823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:12.074352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1423/2865] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 00:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:12.086162 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c1f2e-7c99-45cf-a8cf-2c58c6324737 service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:12.096697 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c1f2e-7c99-45cf-a8cf-2c58c6324737 service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:12.101905 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ac9d3-8abc-411d-82e3-1e0400c8983a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:12.102542 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ac9d3-8abc-411d-82e3-1e0400c8983a service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:12.102875 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ac9d3-8abc-411d-82e3-1e0400c8983a service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:12.103157 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ac9d3-8abc-411d-82e3-1e0400c8983a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:12.111780 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ac9d3-8abc-411d-82e3-1e0400c8983a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:12.113288 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ac9d3-8abc-411d-82e3-1e0400c8983a service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:12.121328 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1443/2866] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:39:14.009774 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630db10-292f-4545-a158-d0899f0d7823 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:14.011304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9630db10-292f-4545-a158-d0899f0d7823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:14.076897 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630db10-292f-4545-a158-d0899f0d7823 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:14.082194 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:14.082807 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.083083 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.083354 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] PATH_INFO: `/v3/users/8003251c1d9a4ac1a9f2ff5bb2987daf` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.084631 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8003251c1d9a4ac1a9f2ff5bb2987daf)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:14.086410 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:14.132018 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8003251c1d9a4ac1a9f2ff5bb2987daf'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.138842 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8003251c1d9a4ac1a9f2ff5bb2987daf'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.139541 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8003251c1d9a4ac1a9f2ff5bb2987daf'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.147300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8003251c1d9a4ac1a9f2ff5bb2987daf'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.158990 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-908dbe91-f3bb-4e61-89b4-8614683851ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8003251c1d9a4ac1a9f2ff5bb2987daf'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.164728 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1424/2867] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:39:14 2022] DELETE /identity/v3/users/8003251c1d9a4ac1a9f2ff5bb2987daf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:39:14.336589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ac9d3-8abc-411d-82e3-1e0400c8983a service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:14.347409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ac9d3-8abc-411d-82e3-1e0400c8983a service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:14.404440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:14.405059 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.405338 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.405609 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] PATH_INFO: `/v3/projects/610f905a50d9496cbc0b067edaf2067c` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.406719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610f905a50d9496cbc0b067edaf2067c)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:14.408615 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:14.453913 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610f905a50d9496cbc0b067edaf2067c', 'request_id': 'req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.459389 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610f905a50d9496cbc0b067edaf2067c', 'request_id': 'req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.465439 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610f905a50d9496cbc0b067edaf2067c', 'request_id': 'req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.477150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] The token cache is being invalidate because project 610f905a50d9496cbc0b067edaf2067c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:39:14.477440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.478087 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-559a2a3a-fdb5-4b2a-8df9-d5a021d91238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:14.479589 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1444/2868] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:39:14 2022] DELETE /identity/v3/projects/610f905a50d9496cbc0b067edaf2067c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:39:14.485686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ffd6-f7de-4aad-b398-1515f05a7c64 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.485972 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ffd6-f7de-4aad-b398-1515f05a7c64 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.486269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ffd6-f7de-4aad-b398-1515f05a7c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.506230 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-7657ffd6-f7de-4aad-b398-1515f05a7c64 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:14.507432 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-7657ffd6-f7de-4aad-b398-1515f05a7c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:14.565289 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1425/2869] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:39:14.572848 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998d96-0838-403b-9bdf-7ff6cf6a1c6c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.573138 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998d96-0838-403b-9bdf-7ff6cf6a1c6c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.573415 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998d96-0838-403b-9bdf-7ff6cf6a1c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.593150 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-a7998d96-0838-403b-9bdf-7ff6cf6a1c6c None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:14.594885 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-a7998d96-0838-403b-9bdf-7ff6cf6a1c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:14.603504 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1445/2870] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:14.607639 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657ffd6-f7de-4aad-b398-1515f05a7c64 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:14.618815 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657ffd6-f7de-4aad-b398-1515f05a7c64 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:14.624221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:14.624835 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.625955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.625955 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.626237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:39:14.626484 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:14.628080 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:14.638056 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:14.641643 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1426/2871] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:39:14.646110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7998d96-0838-403b-9bdf-7ff6cf6a1c6c None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:14.655219 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7998d96-0838-403b-9bdf-7ff6cf6a1c6c None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:14.660283 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5df839-84bb-43fc-b52f-f281368c66c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:14.660868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5df839-84bb-43fc-b52f-f281368c66c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.661147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5df839-84bb-43fc-b52f-f281368c66c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.661418 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5df839-84bb-43fc-b52f-f281368c66c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.662057 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5df839-84bb-43fc-b52f-f281368c66c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:14.663952 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5df839-84bb-43fc-b52f-f281368c66c8 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:14.691096 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1446/2872] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:39:14 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:39:14.695383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:14.705547 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4791d2-ba0c-4647-a026-233bb9d96100 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:14.761313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce462386-1b16-4582-81a7-72e7757de488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:14.761915 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462386-1b16-4582-81a7-72e7757de488 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.762562 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462386-1b16-4582-81a7-72e7757de488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.762843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462386-1b16-4582-81a7-72e7757de488 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.763475 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce462386-1b16-4582-81a7-72e7757de488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:14.765397 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce462386-1b16-4582-81a7-72e7757de488 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:14.787211 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1427/2873] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:39:14 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:39:14.791416 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5df839-84bb-43fc-b52f-f281368c66c8 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:14.802272 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5df839-84bb-43fc-b52f-f281368c66c8 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:14.806928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4ec63-0051-473b-a4f3-d2c2add56189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:14.807521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4ec63-0051-473b-a4f3-d2c2add56189 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.807802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4ec63-0051-473b-a4f3-d2c2add56189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.808077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4ec63-0051-473b-a4f3-d2c2add56189 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.808718 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4ec63-0051-473b-a4f3-d2c2add56189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:14.810337 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4ec63-0051-473b-a4f3-d2c2add56189 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:14.820646 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1447/2874] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:39:14.824292 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce462386-1b16-4582-81a7-72e7757de488 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:14.834007 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce462386-1b16-4582-81a7-72e7757de488 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:14.838558 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6666-47e0-4243-b398-5754b0a9ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:14.839133 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6666-47e0-4243-b398-5754b0a9ed69 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.839411 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6666-47e0-4243-b398-5754b0a9ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.839682 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6666-47e0-4243-b398-5754b0a9ed69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.840308 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d6666-47e0-4243-b398-5754b0a9ed69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:14.841886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d6666-47e0-4243-b398-5754b0a9ed69 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:14.852772 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1428/2875] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:39:14.860745 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4ec63-0051-473b-a4f3-d2c2add56189 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:14.870842 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4ec63-0051-473b-a4f3-d2c2add56189 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:14.875457 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:14.876286 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.876590 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.876864 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] PATH_INFO: `/v3/projects/2242a9e8eef04dc99c7793c0ce0f30d6/users/647b959f777a4661b6087c5f790a1d88/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.892136 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2242a9e8eef04dc99c7793c0ce0f30d6, user_id=647b959f777a4661b6087c5f790a1d88, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:14.895110 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:14.908449 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1448/2876] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:39:14 2022] PUT /identity/v3/projects/2242a9e8eef04dc99c7793c0ce0f30d6/users/647b959f777a4661b6087c5f790a1d88/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:39:14.919147 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84341-a664-4984-8d3f-50ef1c5996bb None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:14.919434 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84341-a664-4984-8d3f-50ef1c5996bb None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:14.919712 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84341-a664-4984-8d3f-50ef1c5996bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:14.946924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-8ce84341-a664-4984-8d3f-50ef1c5996bb None None] MFA Rules not processed for user `647b959f777a4661b6087c5f790a1d88`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:14.948118 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-8ce84341-a664-4984-8d3f-50ef1c5996bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:15.020997 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1429/2877] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:15.033078 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:15.034770 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:15.048894 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:15.091156 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd53cb-c2aa-43aa-ad5b-c7d7a1264a82 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:15.095281 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcd743-6e85-4839-9aec-b8dbfb459aad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d5fb05964b47d5a2f33fe9dde1f65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:15.095869 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd743-6e85-4839-9aec-b8dbfb459aad service glance] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:15.096144 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd743-6e85-4839-9aec-b8dbfb459aad service glance] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:15.096412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd743-6e85-4839-9aec-b8dbfb459aad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:15.104469 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcd743-6e85-4839-9aec-b8dbfb459aad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:15.105868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcd743-6e85-4839-9aec-b8dbfb459aad service glance] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:15.114396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1449/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:39:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 00:39:25.017633 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:25.110561 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=20 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:41.841884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce84341-a664-4984-8d3f-50ef1c5996bb None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:41.905553 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce84341-a664-4984-8d3f-50ef1c5996bb None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:41.910089 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:41.910716 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:41.911000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:41.911273 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] PATH_INFO: `/v3/users/647b959f777a4661b6087c5f790a1d88` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:41.912383 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=647b959f777a4661b6087c5f790a1d88)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:41.914352 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:41.958902 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647b959f777a4661b6087c5f790a1d88'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:41.966340 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647b959f777a4661b6087c5f790a1d88'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:41.966956 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647b959f777a4661b6087c5f790a1d88'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:41.973744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647b959f777a4661b6087c5f790a1d88'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:41.986043 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647b959f777a4661b6087c5f790a1d88'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:41.991933 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1430/2879] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:39:41 2022] DELETE /identity/v3/users/647b959f777a4661b6087c5f790a1d88 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:39:41.996529 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba340d8-69d7-47ba-9e49-ffec091dfa43 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:41.997001 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba340d8-69d7-47ba-9e49-ffec091dfa43 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:41.997115 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba340d8-69d7-47ba-9e49-ffec091dfa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.015409 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-9ba340d8-69d7-47ba-9e49-ffec091dfa43 None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:42.016597 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9ba340d8-69d7-47ba-9e49-ffec091dfa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:42.074736 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1450/2880] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:42.084179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:42.085549 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:42.141845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f654332-a6f9-474e-9b7f-4deb6257f77d admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:42.145845 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6695-ddd8-4f70-910c-ef56f3ce03d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:42.146502 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6695-ddd8-4f70-910c-ef56f3ce03d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.146781 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6695-ddd8-4f70-910c-ef56f3ce03d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.147052 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6695-ddd8-4f70-910c-ef56f3ce03d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.156674 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f6695-ddd8-4f70-910c-ef56f3ce03d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:42.158111 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f6695-ddd8-4f70-910c-ef56f3ce03d3 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:42.167326 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1431/2881] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:39:42.432928 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba340d8-69d7-47ba-9e49-ffec091dfa43 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:42.434613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9ba340d8-69d7-47ba-9e49-ffec091dfa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:42.446451 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba340d8-69d7-47ba-9e49-ffec091dfa43 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:42.452019 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:42.452653 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.452933 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.453234 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] PATH_INFO: `/v3/projects/2242a9e8eef04dc99c7793c0ce0f30d6` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.454379 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2242a9e8eef04dc99c7793c0ce0f30d6)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:42.456282 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:42.503569 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2242a9e8eef04dc99c7793c0ce0f30d6', 'request_id': 'req-95b352a9-a56c-4bf3-8499-19b37bf0dc85'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:42.508906 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2242a9e8eef04dc99c7793c0ce0f30d6', 'request_id': 'req-95b352a9-a56c-4bf3-8499-19b37bf0dc85'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:42.515567 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2242a9e8eef04dc99c7793c0ce0f30d6', 'request_id': 'req-95b352a9-a56c-4bf3-8499-19b37bf0dc85'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:42.527788 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] The token cache is being invalidate because project 2242a9e8eef04dc99c7793c0ce0f30d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:39:42.528076 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:42.528724 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-95b352a9-a56c-4bf3-8499-19b37bf0dc85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:39:42.530205 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1451/2882] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:39:42 2022] DELETE /identity/v3/projects/2242a9e8eef04dc99c7793c0ce0f30d6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:39:42.535179 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3aeb-aa72-485f-ba46-734aa63d91be None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.535499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3aeb-aa72-485f-ba46-734aa63d91be None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.535799 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3aeb-aa72-485f-ba46-734aa63d91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.557035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-dc8f3aeb-aa72-485f-ba46-734aa63d91be None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:42.558265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-dc8f3aeb-aa72-485f-ba46-734aa63d91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:42.575216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:42.618398 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1432/2883] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 00:39:42.626825 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fca8d3-c664-458b-839c-b21cc2b7ee7b None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.627111 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fca8d3-c664-458b-839c-b21cc2b7ee7b None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.627385 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fca8d3-c664-458b-839c-b21cc2b7ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.647544 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e0fca8d3-c664-458b-839c-b21cc2b7ee7b None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:42.648742 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e0fca8d3-c664-458b-839c-b21cc2b7ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:42.656557 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1452/2884] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:42.660675 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f3aeb-aa72-485f-ba46-734aa63d91be None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:42.670574 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f3aeb-aa72-485f-ba46-734aa63d91be None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:42.675140 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:42.675723 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.676000 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.676269 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.676905 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 00:39:42.677204 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:42.678819 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:42.690563 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1433/2885] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Aug 8 00:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 00:39:42.694652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fca8d3-c664-458b-839c-b21cc2b7ee7b None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:42.704243 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fca8d3-c664-458b-839c-b21cc2b7ee7b None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:42.708831 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98dc13-5451-48cb-9b78-10a030effb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:42.709412 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98dc13-5451-48cb-9b78-10a030effb87 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.709687 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98dc13-5451-48cb-9b78-10a030effb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.709955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98dc13-5451-48cb-9b78-10a030effb87 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.710603 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98dc13-5451-48cb-9b78-10a030effb87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:42.712498 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98dc13-5451-48cb-9b78-10a030effb87 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:42.738880 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1453/2886] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:39:42 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:39:42.743077 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:42.753281 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d93527-318b-47b7-9d54-ec451090b6ae admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:42.807265 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989591a-936c-4d3e-ae91-a8d31f8bb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:42.807854 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989591a-936c-4d3e-ae91-a8d31f8bb87e admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.808130 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989591a-936c-4d3e-ae91-a8d31f8bb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.808399 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989591a-936c-4d3e-ae91-a8d31f8bb87e admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.809002 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989591a-936c-4d3e-ae91-a8d31f8bb87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:42.810935 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989591a-936c-4d3e-ae91-a8d31f8bb87e admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:42.833092 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1434/2887] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:39:42 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 00:39:42.837146 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98dc13-5451-48cb-9b78-10a030effb87 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:42.847314 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98dc13-5451-48cb-9b78-10a030effb87 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:42.852009 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f168c3-682e-4e0b-9a9d-72e47190e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:42.852596 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f168c3-682e-4e0b-9a9d-72e47190e94d admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.852872 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f168c3-682e-4e0b-9a9d-72e47190e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.853151 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f168c3-682e-4e0b-9a9d-72e47190e94d admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.853801 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f168c3-682e-4e0b-9a9d-72e47190e94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:42.855434 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f168c3-682e-4e0b-9a9d-72e47190e94d admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:42.865613 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1454/2888] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:39:42.870160 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989591a-936c-4d3e-ae91-a8d31f8bb87e admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:42.881962 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989591a-936c-4d3e-ae91-a8d31f8bb87e admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:42.888313 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46db82-4cfc-45cb-aaea-e039cf300654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:42.888958 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46db82-4cfc-45cb-aaea-e039cf300654 admin admin] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.889239 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46db82-4cfc-45cb-aaea-e039cf300654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.889509 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46db82-4cfc-45cb-aaea-e039cf300654 admin admin] PATH_INFO: `/v3/roles` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.890207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46db82-4cfc-45cb-aaea-e039cf300654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:42.891804 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46db82-4cfc-45cb-aaea-e039cf300654 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:42.903591 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1435/2889] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:39:42.907626 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f168c3-682e-4e0b-9a9d-72e47190e94d admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:42.917944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f168c3-682e-4e0b-9a9d-72e47190e94d admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:42.922635 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:42.923270 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.923550 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.923819 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] PATH_INFO: `/v3/projects/b66d14c4b429456b8eacc4ae04d415f1/users/b3c00b404ef5452eb96e059a0724d32c/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.938920 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66d14c4b429456b8eacc4ae04d415f1, user_id=b3c00b404ef5452eb96e059a0724d32c, role_id=6a2f6ea497c14dac99c12c6c0ba2f2e1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:42.941559 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:42.953804 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1455/2890] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:39:42 2022] PUT /identity/v3/projects/b66d14c4b429456b8eacc4ae04d415f1/users/b3c00b404ef5452eb96e059a0724d32c/roles/6a2f6ea497c14dac99c12c6c0ba2f2e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:39:42.958959 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3108f1-53d7-4b7f-bda3-78c439f41cbb None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:42.959244 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3108f1-53d7-4b7f-bda3-78c439f41cbb None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:42.959516 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3108f1-53d7-4b7f-bda3-78c439f41cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:42.978758 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-ee3108f1-53d7-4b7f-bda3-78c439f41cbb None None] MFA Rules not processed for user `3586962b191746b79d7ae426435a3f36`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:42.979953 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-ee3108f1-53d7-4b7f-bda3-78c439f41cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:43.038691 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1436/2891] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:43.049041 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:43.050847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:43.072772 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:43.109878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7a15-50b0-4045-b441-a2ffef01f3c9 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:43.113525 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbc001-1b2a-4d90-ad7c-70c2c4e11a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:43.114183 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbc001-1b2a-4d90-ad7c-70c2c4e11a79 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:43.114464 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbc001-1b2a-4d90-ad7c-70c2c4e11a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:43.114737 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbc001-1b2a-4d90-ad7c-70c2c4e11a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:43.125197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbc001-1b2a-4d90-ad7c-70c2c4e11a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:43.126586 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbc001-1b2a-4d90-ad7c-70c2c4e11a79 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:43.135877 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1456/2892] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:39:47.293207 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58acfa-6002-4af0-ad78-3fb61a528ce0 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:47.293740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58acfa-6002-4af0-ad78-3fb61a528ce0 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:47.293740 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58acfa-6002-4af0-ad78-3fb61a528ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:47.332525 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-6e58acfa-6002-4af0-ad78-3fb61a528ce0 None None] MFA Rules not processed for user `b3c00b404ef5452eb96e059a0724d32c`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:47.334045 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6e58acfa-6002-4af0-ad78-3fb61a528ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:47.354747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:47.407855 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1437/2893] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:47.412305 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbc001-1b2a-4d90-ad7c-70c2c4e11a79 service neutron] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:47.422640 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbc001-1b2a-4d90-ad7c-70c2c4e11a79 service neutron] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:47.427359 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dafc20-16fe-4452-a3ec-43c3f1a677a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:47.428093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dafc20-16fe-4452-a3ec-43c3f1a677a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:47.428440 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dafc20-16fe-4452-a3ec-43c3f1a677a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:47.428779 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dafc20-16fe-4452-a3ec-43c3f1a677a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:47.429480 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dafc20-16fe-4452-a3ec-43c3f1a677a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:47.431475 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dafc20-16fe-4452-a3ec-43c3f1a677a6 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:47.463435 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1457/2894] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Aug 8 00:39:47 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:39:47.464700 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58acfa-6002-4af0-ad78-3fb61a528ce0 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:47.475742 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58acfa-6002-4af0-ad78-3fb61a528ce0 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:47.535059 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560cb8-5ac3-41b8-9485-622ba68dc0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:47.535686 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560cb8-5ac3-41b8-9485-622ba68dc0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:47.535964 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560cb8-5ac3-41b8-9485-622ba68dc0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:47.536237 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560cb8-5ac3-41b8-9485-622ba68dc0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:47.536870 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560cb8-5ac3-41b8-9485-622ba68dc0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:47.539044 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560cb8-5ac3-41b8-9485-622ba68dc0b2 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:47.562981 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1438/2895] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Aug 8 00:39:47 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 00:39:47.567004 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dafc20-16fe-4452-a3ec-43c3f1a677a6 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:47.577390 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dafc20-16fe-4452-a3ec-43c3f1a677a6 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:47.581839 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf48bb-332c-4302-9382-04080c7568b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:47.582465 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf48bb-332c-4302-9382-04080c7568b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:47.582758 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf48bb-332c-4302-9382-04080c7568b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:47.583023 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf48bb-332c-4302-9382-04080c7568b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:47.583655 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf48bb-332c-4302-9382-04080c7568b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:47.585223 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf48bb-332c-4302-9382-04080c7568b5 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:47.595527 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1458/2896] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 00:39:47.599628 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560cb8-5ac3-41b8-9485-622ba68dc0b2 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:47.610481 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560cb8-5ac3-41b8-9485-622ba68dc0b2 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:47.615101 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5867e-81f4-4fec-a246-ad42deb7f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:47.615739 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5867e-81f4-4fec-a246-ad42deb7f88d admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:47.616035 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5867e-81f4-4fec-a246-ad42deb7f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:47.616290 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5867e-81f4-4fec-a246-ad42deb7f88d admin admin] PATH_INFO: `/v3/projects/de46c0a8d19d450387f8865684818ad3/users/1eac28d4dc064bea9f33ecd1905834b8/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:47.631803 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5867e-81f4-4fec-a246-ad42deb7f88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de46c0a8d19d450387f8865684818ad3, user_id=1eac28d4dc064bea9f33ecd1905834b8, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:47.634735 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5867e-81f4-4fec-a246-ad42deb7f88d admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:47.647418 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1439/2897] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:39:47 2022] PUT /identity/v3/projects/de46c0a8d19d450387f8865684818ad3/users/1eac28d4dc064bea9f33ecd1905834b8/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 00:39:47.651383 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf48bb-332c-4302-9382-04080c7568b5 admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:47.661304 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf48bb-332c-4302-9382-04080c7568b5 admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:47.716652 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e5c68-15c4-47b5-9977-853eb9294e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:47.717252 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5c68-15c4-47b5-9977-853eb9294e1b admin admin] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:47.717535 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5c68-15c4-47b5-9977-853eb9294e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:47.717828 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5c68-15c4-47b5-9977-853eb9294e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:47.718478 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e5c68-15c4-47b5-9977-853eb9294e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:47.720054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e5c68-15c4-47b5-9977-853eb9294e1b admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:47.730207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1459/2898] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Aug 8 00:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 00:39:47.734694 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5867e-81f4-4fec-a246-ad42deb7f88d admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:47.745625 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5867e-81f4-4fec-a246-ad42deb7f88d admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:47.750456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:47.751125 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] REQUEST_METHOD: `PUT` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:47.751400 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:47.751668 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] PATH_INFO: `/v3/projects/de46c0a8d19d450387f8865684818ad3/users/1eac28d4dc064bea9f33ecd1905834b8/roles/1ffa1545737240e1be8af23984ab85c1` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:47.753582 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de46c0a8d19d450387f8865684818ad3, user_id=1eac28d4dc064bea9f33ecd1905834b8, role_id=1ffa1545737240e1be8af23984ab85c1)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:47.756231 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:47.766330 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1440/2899] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Aug 8 00:39:47 2022] PUT /identity/v3/projects/de46c0a8d19d450387f8865684818ad3/users/1eac28d4dc064bea9f33ecd1905834b8/roles/1ffa1545737240e1be8af23984ab85c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:39:52.224774 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2326f-237d-430c-826d-6af02d1988c4 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:52.225334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2326f-237d-430c-826d-6af02d1988c4 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:52.225334 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2326f-237d-430c-826d-6af02d1988c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:52.256938 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-e0b2326f-237d-430c-826d-6af02d1988c4 None None] MFA Rules not processed for user `1eac28d4dc064bea9f33ecd1905834b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:52.258217 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-e0b2326f-237d-430c-826d-6af02d1988c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:52.341021 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1460/2900] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:39:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:52.355117 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:52.357903 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:52.439513 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c3d50-0354-4090-acb5-fe14b877f51b admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:52.445983 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d5fb05964b47d5a2f33fe9dde1f65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:52.446862 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:52.447122 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:52.447424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:52.477241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:52.512078 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:52.513531 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:52.523032 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1441/2901] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:39:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:39:52.649847 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9483-3b11-4b3a-b1f8-4bf2b341839c None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:52.650204 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9483-3b11-4b3a-b1f8-4bf2b341839c None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:52.650483 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9483-3b11-4b3a-b1f8-4bf2b341839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:52.671139 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-f63f9483-3b11-4b3a-b1f8-4bf2b341839c None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:39:52.672511 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-f63f9483-3b11-4b3a-b1f8-4bf2b341839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:52.678500 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:52.741054 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1461/2902] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:39:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:39:52.762623 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:39:52.764019 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:39:52.833884 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd3d01-cbd8-42b1-a9b7-a89b9eb2e291 service glance] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:39:52.838829 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:39:52.839424 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:39:52.839698 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:39:52.839966 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:39:52.847703 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:39:52.849287 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:39:52.857984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1442/2903] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:39:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:40:02.215119 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd4c5-b163-4674-8ab1-3c90133afa43 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:02.215607 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd4c5-b163-4674-8ab1-3c90133afa43 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:02.215725 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd4c5-b163-4674-8ab1-3c90133afa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:02.234093 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-8b6fd4c5-b163-4674-8ab1-3c90133afa43 None None] MFA Rules not processed for user `b3c00b404ef5452eb96e059a0724d32c`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:40:02.235299 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8b6fd4c5-b163-4674-8ab1-3c90133afa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:02.241992 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1462/2904] 10.222.0.23 () {58 vars in 958 bytes} [Mon Aug 8 00:40:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:40:02.492191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:40:02.493726 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:02.550414 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731fdb3-a1f3-4f72-a7cc-5b900c8fc1eb service swift] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:40:02.553984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d22dc-f801-4f1a-b831-585e9028ce8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:40:02.554605 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d22dc-f801-4f1a-b831-585e9028ce8d service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:02.554886 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d22dc-f801-4f1a-b831-585e9028ce8d service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:02.555161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d22dc-f801-4f1a-b831-585e9028ce8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:02.556843 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-6e4d22dc-f801-4f1a-b831-585e9028ce8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:02.566796 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d22dc-f801-4f1a-b831-585e9028ce8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:40:02.568221 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d22dc-f801-4f1a-b831-585e9028ce8d service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:40:02.576405 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1443/2905] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:40:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:40:02.899396 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fd4c5-b163-4674-8ab1-3c90133afa43 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:40:02.900816 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-8b6fd4c5-b163-4674-8ab1-3c90133afa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:02.971053 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fd4c5-b163-4674-8ab1-3c90133afa43 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:40:02.977719 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:40:02.978356 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:02.978642 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:02.978919 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:02.981195 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:02.993488 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:40:02.995153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:40:03.007802 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1463/2906] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:40:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:40:04.248621 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbeb08-75a2-46cc-af3d-775f91f0e7e2 None None] REQUEST_METHOD: `POST` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:04.249175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbeb08-75a2-46cc-af3d-775f91f0e7e2 None None] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:04.249175 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbeb08-75a2-46cc-af3d-775f91f0e7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:04.268406 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.auth.core [None req-75dbeb08-75a2-46cc-af3d-775f91f0e7e2 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:40:04.269602 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-75dbeb08-75a2-46cc-af3d-775f91f0e7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:04.277386 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1444/2907] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Aug 8 00:40:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:40:04.291143 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:40:04.303507 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd78c5-ea21-4953-bcd4-a2a2948df904 service placement] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:40:04.309408 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:40:04.310135 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:04.310491 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:04.310833 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:04.321502 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:40:04.323672 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:40:04.332197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1464/2908] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:40:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:40:14.263128 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=77 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:14.329242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=61 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:14.955526 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbeb08-75a2-46cc-af3d-775f91f0e7e2 None None] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:40:14.965741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbeb08-75a2-46cc-af3d-775f91f0e7e2 None None] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:40:14.969293 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:40:14.969880 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:14.970187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:14.970459 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:14.972187 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:14.982368 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:40:14.983795 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:40:14.992102 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1445/2909] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:40:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:40:15.542754 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:40:15.545149 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:15.621080 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5be9c-adfc-49ea-ba33-f8cdc4c31d70 service swift] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:40:15.626759 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:40:15.627496 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:15.627785 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:15.628058 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:15.629790 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:15.642262 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:40:15.643823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:40:15.655720 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1465/2910] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:40:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:40:21.958744 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:40:21.960216 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:21.976499 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7409-a50e-402b-8bc3-c3c1e32f2147 service neutron] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:40:21.982455 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6573439abd4afb8098390eb4c7e5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:40:21.983046 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:21.983321 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:21.983590 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:21.985296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:40:21.998200 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:40:21.999924 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:40:22.010736 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1446/2911] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:40:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:40:25.650344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=34 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:28.958503 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:40:28.967822 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a032188-720c-4f21-a2f7-4496781163ff service nova] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:40:28.971368 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77264-811f-46ba-9c8d-6f89ec6fed46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a501a048ed4b6c8186bfd490ad1394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:40:28.971950 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77264-811f-46ba-9c8d-6f89ec6fed46 service neutron] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:40:28.972226 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77264-811f-46ba-9c8d-6f89ec6fed46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:40:28.972495 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77264-811f-46ba-9c8d-6f89ec6fed46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:40:28.981103 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b77264-811f-46ba-9c8d-6f89ec6fed46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:40:28.982676 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b77264-811f-46ba-9c8d-6f89ec6fed46 service neutron] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:40:28.991976 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1466/2912] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:40:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:40:32.006241 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=12 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:38.987764 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=6 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:42:40.695503 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:42:40.706865 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7a8b0-dcc7-4162-9ee6-fbd17d18e868 service nova] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:42:40.711784 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:42:40.712403 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:42:40.712679 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:42:40.712947 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:42:40.715161 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:42:40.726609 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:42:40.728192 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:42:40.738647 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1447/2913] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:42:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:42:50.734349 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=6 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:42:57.775182 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85f85-d1f9-4fd2-92f3-94969700f226 None None] REQUEST_METHOD: `POST` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:42:57.776343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85f85-d1f9-4fd2-92f3-94969700f226 None None] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:42:57.776343 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85f85-d1f9-4fd2-92f3-94969700f226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:42:57.795256 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.auth.core [None req-10c85f85-d1f9-4fd2-92f3-94969700f226 None None] MFA Rules not processed for user `ae7cde8433d046ec9cacb1665c03cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=86588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 00:42:57.796470 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-10c85f85-d1f9-4fd2-92f3-94969700f226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:42:57.803509 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1467/2914] 10.222.0.23 () {58 vars in 967 bytes} [Mon Aug 8 00:42:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 00:42:57.844135 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:42:57.855614 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a7238-7671-4cfd-ad44-312d968ea225 service placement] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:42:57.860586 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0a930-5d4e-4861-9310-a6432a6e8346 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faeb9592d8fd4906a1298e7e550c1e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:42:57.861205 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0a930-5d4e-4861-9310-a6432a6e8346 service swift] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:42:57.861483 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0a930-5d4e-4861-9310-a6432a6e8346 service swift] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:42:57.861757 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0a930-5d4e-4861-9310-a6432a6e8346 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:42:57.870565 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0a930-5d4e-4861-9310-a6432a6e8346 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:42:57.872163 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0a930-5d4e-4861-9310-a6432a6e8346 service swift] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:42:57.885944 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1448/2915] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Aug 8 00:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 00:43:01.238643 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85f85-d1f9-4fd2-92f3-94969700f226 None None] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:43:01.250930 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85f85-d1f9-4fd2-92f3-94969700f226 None None] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:43:01.255944 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:43:01.256515 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] REQUEST_METHOD: `GET` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:43:01.256823 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:43:01.257092 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:43:01.258846 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:43:01.270476 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:43:01.272077 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:43:01.284795 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1468/2916] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:43:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:43:04.174832 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0a930-5d4e-4861-9310-a6432a6e8346 service swift] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:43:04.248300 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0a930-5d4e-4861-9310-a6432a6e8346 service swift] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:43:04.252957 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:43:04.253580 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:43:04.253858 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:43:04.254158 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] PATH_INFO: `/v3/users/b3c00b404ef5452eb96e059a0724d32c` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:43:04.255286 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c00b404ef5452eb96e059a0724d32c)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:43:04.257191 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:43:04.311741 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c00b404ef5452eb96e059a0724d32c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.319016 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c00b404ef5452eb96e059a0724d32c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.319797 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c00b404ef5452eb96e059a0724d32c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.327601 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c00b404ef5452eb96e059a0724d32c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.339419 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c00b404ef5452eb96e059a0724d32c'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.345345 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1449/2917] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:43:04 2022] DELETE /identity/v3/users/b3c00b404ef5452eb96e059a0724d32c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:43:04.511521 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:43:04.525210 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878ce27-a42c-4723-b8b3-3a04c281efdf service placement] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:43:04.581955 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:43:04.582606 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:43:04.582886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:43:04.583179 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] PATH_INFO: `/v3/projects/b66d14c4b429456b8eacc4ae04d415f1` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:43:04.584301 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66d14c4b429456b8eacc4ae04d415f1)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:43:04.586207 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:43:04.631812 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66d14c4b429456b8eacc4ae04d415f1', 'request_id': 'req-b2acd536-752f-4f6d-8814-b0e601ca626c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.637116 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66d14c4b429456b8eacc4ae04d415f1', 'request_id': 'req-b2acd536-752f-4f6d-8814-b0e601ca626c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.643220 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66d14c4b429456b8eacc4ae04d415f1', 'request_id': 'req-b2acd536-752f-4f6d-8814-b0e601ca626c'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.654982 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] The token cache is being invalidate because project b66d14c4b429456b8eacc4ae04d415f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:43:04.655265 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.655878 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.657344 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1469/2918] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:43:04 2022] DELETE /identity/v3/projects/b66d14c4b429456b8eacc4ae04d415f1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:43:04.661328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:43:04.662841 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:43:04.675987 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74b53-6030-4292-ad4d-9ff5c2d435c7 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:43:04.731136 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:43:04.731747 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:43:04.732024 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:43:04.732296 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] PATH_INFO: `/v3/users/1eac28d4dc064bea9f33ecd1905834b8` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:43:04.733422 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eac28d4dc064bea9f33ecd1905834b8)` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:43:04.735361 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:43:04.740535 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:04.782441 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eac28d4dc064bea9f33ecd1905834b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.789831 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eac28d4dc064bea9f33ecd1905834b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.790456 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eac28d4dc064bea9f33ecd1905834b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.797984 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eac28d4dc064bea9f33ecd1905834b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.809938 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.notifications [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eac28d4dc064bea9f33ecd1905834b8'} {{(pid=86589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:04.815893 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1450/2919] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Aug 8 00:43:04 2022] DELETE /identity/v3/users/1eac28d4dc064bea9f33ecd1905834b8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:43:04.991665 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] Authenticating user token {{(pid=86588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:43:04.993153 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.fernet_utils [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:43:05.008197 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd536-752f-4f6d-8814-b0e601ca626c admin admin] Validating token access rules against request {{(pid=86588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:43:05.068413 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3586962b191746b79d7ae426435a3f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bbcd4a1f6a42dcb7f98d6bb69581ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:43:05.069392 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:43:05.069868 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:43:05.070397 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] PATH_INFO: `/v3/projects/de46c0a8d19d450387f8865684818ad3` {{(pid=86588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:43:05.072771 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de46c0a8d19d450387f8865684818ad3)` {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:43:05.075147 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] RBAC: Authorization granted {{(pid=86588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:43:05.086583 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:05.122429 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de46c0a8d19d450387f8865684818ad3', 'request_id': 'req-0ae33815-2581-4d26-9d40-edd95339c447'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:05.127904 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de46c0a8d19d450387f8865684818ad3', 'request_id': 'req-0ae33815-2581-4d26-9d40-edd95339c447'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:05.133849 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de46c0a8d19d450387f8865684818ad3', 'request_id': 'req-0ae33815-2581-4d26-9d40-edd95339c447'} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:05.146336 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] The token cache is being invalidate because project de46c0a8d19d450387f8865684818ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 00:43:05.146619 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:05.147242 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG keystone.notifications [None req-0ae33815-2581-4d26-9d40-edd95339c447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 00:43:05.148886 dv-cinder-851640-3-smb devstack@keystone.service[86588]: [pid: 86588|app: 0|req: 1470/2920] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Aug 8 00:43:04 2022] DELETE /identity/v3/projects/de46c0a8d19d450387f8865684818ad3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 00:43:14.812312 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:15.143425 dv-cinder-851640-3-smb devstack@keystone.service[86588]: DEBUG dbcounter [-] [86588] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:47:46.735328 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] Authenticating user token {{(pid=86589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 00:47:46.736780 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:47:46.877662 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9a7e5-8173-4d3f-ba54-6d445b3c8209 admin admin] Validating token access rules against request {{(pid=86589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 00:47:46.936416 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad6a2e-a04d-4533-a8b2-82fab47ba9e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a35c6a59728d4b3c9fad8599c88f779e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '575eaa0faad84155959ef314d59f590c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 00:47:46.937015 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad6a2e-a04d-4533-a8b2-82fab47ba9e0 service placement] REQUEST_METHOD: `GET` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 00:47:46.937304 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad6a2e-a04d-4533-a8b2-82fab47ba9e0 service placement] SCRIPT_NAME: `/identity` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 00:47:46.938208 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad6a2e-a04d-4533-a8b2-82fab47ba9e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 00:47:46.939986 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.fernet_utils [None req-9fad6a2e-a04d-4533-a8b2-82fab47ba9e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 00:47:46.951202 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad6a2e-a04d-4533-a8b2-82fab47ba9e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 00:47:46.952790 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad6a2e-a04d-4533-a8b2-82fab47ba9e0 service placement] RBAC: Authorization granted {{(pid=86589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 00:47:46.962559 dv-cinder-851640-3-smb devstack@keystone.service[86589]: [pid: 86589|app: 0|req: 1451/2921] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Aug 8 00:47:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 00:47:56.958409 dv-cinder-851640-3-smb devstack@keystone.service[86589]: DEBUG dbcounter [-] [86589] Writing DB stats keystone:SELECT=89 {{(pid=86589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}